-- Logs begin at Tue 2022-06-14 16:44:53 UTC, end at Tue 2022-06-14 18:16:55 UTC. -- Jun 14 17:49:05.018029 dv-cinder-826350-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 14 17:49:05.026724 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 17:49:05 2022] *** Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: nodename: dv-cinder-826350-5-iscsi Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: machine: x86_64 Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: clock source: unix Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: pcre jit disabled Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: detected number of CPU cores: 4 Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: current working directory: / Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: detected binary path: /usr/bin/uwsgi-core Jun 14 17:49:05.028713 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: your processes number limit is 47680 Jun 14 17:49:05.029504 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: your memory page size is 4096 bytes Jun 14 17:49:05.029504 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: detected max file descriptor number: 2048 Jun 14 17:49:05.029504 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: lock engine: pthread robust mutexes Jun 14 17:49:05.029504 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: thunder lock: enabled Jun 14 17:49:05.029504 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 14 17:49:05.029504 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 17:49:05.072570 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: Python main interpreter initialized at 0x55f6190499c0 Jun 14 17:49:05.072570 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: python threads support enabled Jun 14 17:49:05.072570 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: your server socket listen backlog is limited to 100 connections Jun 14 17:49:05.072570 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: your mercy for graceful operations on workers is 90 seconds Jun 14 17:49:05.072975 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 17:49:05.072975 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: *** Operational MODE: preforking *** Jun 14 17:49:05.073243 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: *** uWSGI is running in multiple interpreter mode *** Jun 14 17:49:05.073243 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: spawned uWSGI master process (pid: 110302) Jun 14 17:49:05.073445 dv-cinder-826350-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 14 17:49:05.074510 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: spawned uWSGI worker 1 (pid: 110303, cores: 1) Jun 14 17:49:05.074510 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: spawned uWSGI worker 2 (pid: 110304, cores: 1) Jun 14 17:49:05.074510 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 17:49:05.748748 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 17:49:05.759481 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 17:49:06.945399 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:49:06.945399 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: from cryptography.utils import int_from_bytes Jun 14 17:49:06.946000 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:49:06.946000 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: from cryptography.utils import int_from_bytes Jun 14 17:49:06.958517 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:49:06.958517 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: from cryptography.utils import int_from_bytes Jun 14 17:49:06.959047 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:49:06.959047 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: from cryptography.utils import int_from_bytes Jun 14 17:49:09.538719 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:49:09.539341 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:49:09.539512 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:49:09.539879 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:49:09.540235 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:49:09.540522 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.540829 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:49:09.541258 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.541365 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:49:09.541448 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.541526 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.541604 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:49:09.541821 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.541963 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:49:09.542140 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.542233 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:49:09.542462 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.542567 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.542781 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.542870 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.543109 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.543196 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.543399 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.543501 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.543721 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.543817 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544050 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-5-iscsi {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544137 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544382 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544505 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544686 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544782 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.544996 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.545092 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.545246 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.545346 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.545553 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.545640 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.545870 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-5-iscsi {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.546024 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.546180 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.546276 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.546477 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.546688 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.546801 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.547265 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.547430 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.547607 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.547701 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.547959 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.548057 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.548306 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.548623 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.548714 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.548938 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.549168 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.549310 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.549506 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.549617 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.549815 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.549923 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.550108 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.550212 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.550455 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.550623 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-5-iscsi {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.550766 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.550911 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.551070 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.551202 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.551358 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.551487 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.551653 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.551871 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552006 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552183 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552316 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552494 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552640 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-5-iscsi {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552816 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.552948 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.553150 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.553249 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.553459 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.553547 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.553787 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.553930 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.554108 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.554236 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.554429 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.554520 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.554751 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.554838 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.555056 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.555159 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.555391 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.555571 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.555708 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.555899 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556037 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556213 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556344 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556530 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556652 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556843 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.556938 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.557139 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.557226 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.557441 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.557527 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.557745 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.557833 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558058 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558144 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558357 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558526 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558617 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558715 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558889 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.558975 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.559189 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.559405 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.559530 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.559619 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.559848 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.559941 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560153 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560252 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560398 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560493 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560631 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560756 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.560972 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561078 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561292 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561388 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561594 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561681 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561894 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.561983 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.562194 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.562288 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.562530 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.562647 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.562902 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.563223 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.563330 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.563643 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.563734 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.563937 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564035 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564209 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564296 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564551 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564639 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564865 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.564951 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.565175 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.565260 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.565479 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.565564 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.565798 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.565886 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.566109 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.566217 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.566415 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.566512 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.566721 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.566822 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567036 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567122 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567382 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567485 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567688 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567775 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.567940 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568027 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568242 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568341 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568548 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568643 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568869 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.568965 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.569167 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.569263 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.569471 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.569564 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.569777 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.569865 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570080 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570169 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570324 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570411 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570621 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570717 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.570922 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571019 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571237 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571352 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571564 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571660 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571866 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.571962 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.572172 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.572264 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.572478 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.572565 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.572783 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.572871 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573082 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573176 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573384 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573472 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573683 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573778 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.573982 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574076 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574278 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574384 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574576 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574671 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574875 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.574971 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.575174 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.575262 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.575504 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.575600 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.575817 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.575919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.576173 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.576282 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.576410 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.576500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.576709 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.576833 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577014 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577310 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577408 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577605 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577692 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.577903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.578000 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.578725 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.578861 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.579197 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.579286 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.579617 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.579779 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.579927 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580073 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580231 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580366 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580533 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580697 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.580976 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.581132 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.581270 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.581433 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.581580 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.581730 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.581885 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582046 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582182 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582327 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582473 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582610 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582744 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.582887 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583034 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583176 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583331 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583474 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583622 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583758 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.583924 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.584085 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.584223 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.584367 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.584503 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.584641 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.584849 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.584990 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.585167 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.585312 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.585503 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.585647 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.585860 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.585993 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.586136 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:49:09.586299 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.586422 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.586517 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.586749 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.586845 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.587076 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.587164 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.587405 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.587495 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.587720 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.587808 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588033 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588120 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588347 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588441 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588654 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588756 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.588963 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.589071 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.589282 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.589379 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.589596 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.589686 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.589916 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590014 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590283 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590378 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590597 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590685 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590911 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.590998 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.591235 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.591365 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.591570 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.591667 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.591884 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.591977 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.592202 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.592299 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.592505 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.592594 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.592816 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.592914 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.593140 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.593240 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.593454 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.593541 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.594435 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.594782 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.594986 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.595225 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.595384 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.595672 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.595759 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.595995 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.596097 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.596322 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.596461 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.596641 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.596743 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.596958 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.597061 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.597275 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.597362 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.597590 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.597677 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.597906 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598013 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598249 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598345 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598557 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598643 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598873 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.598989 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.599184 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.599282 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.599516 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.599607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.599824 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.599913 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.600132 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.600220 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.600442 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.600528 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.600750 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.600839 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601056 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601156 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601365 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601453 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601673 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601764 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.601977 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.602114 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.602299 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.602473 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.602629 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.602819 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.602938 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.603129 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.603459 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.603569 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.603765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.603873 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.604080 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.604167 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.604393 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.604493 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.604695 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.604783 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605004 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605093 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605319 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605421 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605621 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605716 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.605927 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606014 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606239 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606334 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606546 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606852 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.606938 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.607154 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.607248 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.607479 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.607575 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.607787 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.607875 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.608093 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.608182 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.608393 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.608481 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.608704 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.608790 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.609007 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.609094 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.609311 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.609429 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.609859 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.610183 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.610351 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.610501 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.610597 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.610816 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.610899 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.611135 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.611231 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.611487 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.611578 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.611815 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.611902 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.612129 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.612221 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.612440 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.612551 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.612749 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.612837 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613063 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613161 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613372 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613461 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613682 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613769 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.613991 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.614080 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.614303 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.614390 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.614622 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.614787 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.614918 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615015 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615228 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615335 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615553 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615656 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615859 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.615959 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.616156 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.616243 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.616456 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.616553 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.616758 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.616849 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.617063 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.617150 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.617363 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.617632 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.617721 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.617947 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.618034 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.618244 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.618344 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.618543 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.618686 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.618864 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.619001 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.619175 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.619286 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.619610 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.619757 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.619896 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620036 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620168 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620309 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620447 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620584 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620719 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620854 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.620989 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.621138 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.621292 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.621430 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.621605 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.621756 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.621924 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.622062 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.622232 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.622365 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.622543 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.622680 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.622857 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.623001 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.623161 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.623328 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.623495 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.623643 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.623900 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624001 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624221 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624316 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624527 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624670 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624840 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.624997 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.625291 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.625676 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.625822 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.625989 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.626130 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.626308 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.626440 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.626621 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.626713 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.626934 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.627069 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.627247 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.627424 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.627587 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.627720 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.627910 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628043 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628222 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628545 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628678 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628851 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.628989 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.629161 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.629252 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.629467 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.629640 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.629787 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.629929 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630067 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630219 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630378 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630524 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630663 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630805 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.630938 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.631070 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.631242 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.631464 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.631601 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.631750 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.631886 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632030 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632168 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632317 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632454 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632590 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632747 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.632880 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.633061 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.633211 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.633381 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.633528 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.633708 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.633851 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634015 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634161 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634305 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634439 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634619 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634758 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.634908 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635042 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635210 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635376 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635539 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635682 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635828 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.635966 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.636112 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.636257 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.636438 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.636569 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.636763 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.636916 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.637062 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.637196 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.637385 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.637527 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.637699 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.637831 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.638003 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.638381 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.638557 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.638696 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.638856 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.638996 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.639136 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.639267 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.639451 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.639694 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.639835 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.639983 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.640120 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.640210 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.640363 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.640504 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.641261 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.641576 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.641667 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.641896 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642027 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642221 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642360 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642535 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642674 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642842 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.642981 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.643147 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.643285 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.643478 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.643610 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.643788 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.643931 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.644103 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.644240 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.644414 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.644565 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.644703 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.644846 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645008 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645140 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645322 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645453 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645629 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645769 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.645941 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646071 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646243 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646374 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646534 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646679 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646848 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.646963 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.647163 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.647349 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.647497 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.647641 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.647776 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.647912 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.648047 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.648338 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.648491 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.648639 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.648774 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.648943 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649080 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649246 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649390 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649550 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649688 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649857 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.649992 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.650141 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.650277 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.650445 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.650600 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.650756 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.650954 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.651264 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.651390 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.651610 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.651700 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.651921 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652016 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652350 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652461 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652545 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652626 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652837 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.652927 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.653144 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.653241 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.653451 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.653539 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.653763 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.653861 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654069 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654167 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654374 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654464 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654675 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654770 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.654975 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.655079 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.655289 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.655445 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.655616 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.655709 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.655931 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.656019 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.656300 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.657174 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.657454 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.657560 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.657759 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.657878 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658066 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658377 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658485 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658673 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658773 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.658978 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.659067 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.659288 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.659441 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.659617 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.659718 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.659924 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660013 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660225 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660322 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660543 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660640 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660881 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.660977 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.661182 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.661278 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.661482 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.661580 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.661780 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.661868 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.662089 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.662176 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.662400 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.662498 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.662706 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.662795 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.663041 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.663131 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.663409 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.663516 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.663714 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.663805 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664017 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664114 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664322 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664465 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664626 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664714 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.664925 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665090 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665222 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665312 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665526 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665662 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665828 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.665927 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.666131 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.666219 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.666436 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.666583 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.666722 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.666867 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667011 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667148 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667374 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667507 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667647 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667798 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.667934 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668070 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668214 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668357 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668511 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668656 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668793 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.668928 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669063 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669209 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669370 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669506 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669643 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669778 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.669921 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.670066 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.670210 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.670348 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.670580 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.670713 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.670887 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671027 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671185 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671352 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671507 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671642 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671825 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.671975 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.672260 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.672590 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.672734 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.672912 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673051 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673221 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673376 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673531 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673670 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673837 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.673976 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.674142 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.674281 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.674448 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.674566 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.674753 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.674855 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.675058 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.675148 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.675418 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.675526 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.675725 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.675835 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676027 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676114 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676330 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676415 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676644 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676738 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.676945 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677064 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677249 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677352 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677550 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677662 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677855 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.677944 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.678227 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.678312 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.678530 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.678625 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.678827 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.678915 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.679124 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.679218 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.679445 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.679547 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.679748 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.679845 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680052 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680205 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680369 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680503 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680671 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680808 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.680971 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.681110 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.681268 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.681461 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.681598 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.681735 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.681889 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682046 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682190 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682337 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682497 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682797 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.682949 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.683107 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.683240 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.683453 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.683593 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.683736 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.683885 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684021 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684156 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684303 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684450 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684590 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684685 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684896 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.684985 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.685199 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.685288 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.685505 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.685608 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.685803 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.685892 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.686099 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.686186 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.686465 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.686926 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.686926 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.687086 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.687175 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.687256 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.687370 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.687509 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.687777 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.688089 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.688230 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.688378 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.688524 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.688691 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.688870 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689015 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689245 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689382 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689546 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689682 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689817 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.689953 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.690096 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.690286 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.690473 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.690625 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.690768 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.690905 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691041 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691191 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691358 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691525 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691675 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691813 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.691947 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692094 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692237 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692379 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692561 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692712 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692847 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.692990 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.693133 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.693280 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.693424 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.693583 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.693740 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.693950 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694094 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694237 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694371 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694503 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694632 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694820 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.694956 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.695091 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.695344 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.695456 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.695659 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.695751 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.695960 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696047 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696262 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696349 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696568 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696657 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696872 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.696959 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.697178 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.697262 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.697483 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.697578 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.697785 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.697884 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.698098 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.698199 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.698421 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.698508 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.698775 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.698862 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.699078 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.699174 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.699398 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.699490 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.699698 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.699859 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700173 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700324 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700475 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700617 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700797 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.700976 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.701161 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.701314 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.701451 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.701586 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.701761 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.701914 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.702077 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.702222 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.702389 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.702528 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.702717 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.702863 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.703042 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.703724 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.703927 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.704353 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.704521 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.704675 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.704812 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.704989 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.705087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.705288 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.705377 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.705669 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.705756 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.705999 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.706117 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.706305 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.706405 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.706616 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.706823 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.706919 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.707093 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.707228 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.707451 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.707557 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.707782 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.707931 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.708090 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.708180 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.708398 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.708491 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.708710 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.708808 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.709016 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.709105 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.709371 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.709490 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.709713 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.709804 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710024 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710190 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710337 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710514 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710652 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710819 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.710960 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.711136 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.711274 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.711482 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.711612 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.711782 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.711940 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712081 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712248 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712385 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712571 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712687 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712890 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.712985 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.713215 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.713311 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.713540 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.713627 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.713850 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.713937 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.714157 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.714260 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.714462 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.714549 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.714774 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.714866 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.715053 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.715158 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.715381 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.715471 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.715719 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.715805 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716025 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716112 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716439 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716645 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716743 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.716960 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717049 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717260 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717346 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717575 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717676 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717891 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.717978 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.718178 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.718279 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.718469 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.718567 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.719559 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.719673 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.719947 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.720248 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.720336 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.720560 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.720733 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.720879 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721015 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721153 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721316 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721645 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721791 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.721929 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722067 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722211 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722356 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722501 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722636 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722781 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.722942 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.723100 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.723243 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.723406 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.723591 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.723724 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.723902 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.724047 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.724211 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.724356 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.724516 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.724660 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.724816 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725043 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725251 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725393 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725538 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725681 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725832 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.725968 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726107 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726261 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726419 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726557 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726699 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726833 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.726970 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.727125 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.727265 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.727448 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.727596 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.727772 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.727898 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.728091 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.728182 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.728410 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.728509 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.728728 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.728825 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729045 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729141 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729362 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729459 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729679 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729776 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.729990 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.730079 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.730308 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.730399 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.730608 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.730752 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.730930 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.731019 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.731357 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.731621 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.731933 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.732066 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.732242 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.732411 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.732552 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.732734 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.732862 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.733055 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.733152 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.733373 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.733465 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.733694 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.733857 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.734010 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.734176 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.734351 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.734668 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.734984 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.735134 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.735327 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.735654 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.735828 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.735982 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.736081 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.736293 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.736420 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.736608 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.736710 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.736918 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737017 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737228 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737324 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737536 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737625 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737843 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.737932 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.738149 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.738251 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.738492 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.738583 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.738799 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.738896 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.739114 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.739211 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.739462 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.739554 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.739777 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.739867 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.740093 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.740201 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.740405 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.740492 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.740717 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.740852 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741025 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741127 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741340 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741449 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741643 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741768 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.741960 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742058 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742277 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742366 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742584 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742673 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742894 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.742985 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.743203 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.743293 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.743533 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.743636 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.743838 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.743928 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.744145 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.744248 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.744456 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.744667 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.744758 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.744992 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.745082 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.745331 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.745430 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.745634 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.745723 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.745951 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746049 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746279 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746377 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746592 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746684 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746897 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.746985 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.747202 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.747334 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.747534 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.747641 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.747845 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748043 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748139 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748354 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748451 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748679 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748778 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.748996 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.749086 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.749313 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.749410 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.749623 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.749711 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.750430 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.750564 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.751046 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.751278 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.751428 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.751605 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.751752 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.751908 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.752087 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.752292 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.752567 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.752662 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.752755 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.752846 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753023 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753161 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753352 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753467 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753666 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753764 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.753975 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.754071 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.754292 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.754382 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.754606 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.754875 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.754964 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.755204 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.755291 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.755542 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.755651 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.755856 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.755945 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.756160 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.756249 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.756473 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.756568 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.756775 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.756864 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757092 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757180 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757394 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757490 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757782 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.757999 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758300 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758431 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758600 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758689 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758898 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.758993 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.759200 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.759290 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.759527 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.759629 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.759826 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.759915 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.760129 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.760218 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.760424 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.760526 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.760731 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.760819 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761030 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761119 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761327 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761418 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761623 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761721 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.761925 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762021 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762241 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762348 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762545 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762676 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762861 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.762970 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.763461 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.763557 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.763772 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.763871 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764073 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764173 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764380 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764469 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764678 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764775 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.764983 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.765073 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.765280 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.765369 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.765595 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.766410 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.766746 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.766944 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.767073 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.767277 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.767438 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.767607 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.767775 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.767913 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.768088 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.768336 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.768434 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.768653 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.768746 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.768979 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.769066 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.769293 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.769391 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.769602 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.769689 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.769918 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.770016 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.770228 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.770318 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.770537 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.770755 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.770844 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.771087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.771188 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.771466 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.771633 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.771769 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.771921 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.772052 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.772198 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.772366 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.773591 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.773686 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.773756 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.773821 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.773904 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.773972 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774046 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774114 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774179 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774252 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774319 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774390 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774463 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774529 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774594 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774805 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.774892 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.775124 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.775222 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.775446 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.775561 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.775751 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.775857 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776055 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776143 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776356 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776457 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776659 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776761 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.776965 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777061 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777268 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777384 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777574 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777671 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777907 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.777995 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.778219 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.778318 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.778547 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.778633 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.778839 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.778937 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.779153 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.779259 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.779511 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.779598 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.779778 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.779870 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.780084 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.780182 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.780386 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.780484 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.780729 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.780822 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.781052 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.781174 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.781440 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.781768 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.782076 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.782385 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.782695 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.782868 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.783004 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.783205 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.783339 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.783659 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.783964 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784052 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784268 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784374 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784579 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784669 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784884 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.784981 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.785189 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.785291 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.785491 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.785588 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.785798 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.785895 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.786106 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.786208 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.786407 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.786494 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.786711 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.786807 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787018 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787194 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787395 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787488 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787637 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787728 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.787942 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.788043 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.788250 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.788340 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.788553 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.788661 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.788904 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789004 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789163 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789254 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789466 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789566 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789770 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.789869 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.790088 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.790182 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.790401 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.790491 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.790702 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.790791 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.791002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.791096 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.791352 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.791484 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.791680 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.791770 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792012 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792108 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792310 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792407 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792609 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792697 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792908 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.792998 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.793207 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.793304 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.793507 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.793618 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.793805 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.793934 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.794108 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.794244 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.794407 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.794553 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.794711 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.794863 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.795042 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.795171 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.795362 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.795516 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.795664 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.795850 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.796021 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.796178 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.796307 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.796486 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.796617 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.796835 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.797056 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.797185 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.797465 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.797766 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.797855 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.798081 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.798178 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.798397 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.798485 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.798712 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.798800 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.799024 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.799115 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.799423 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.799516 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.799738 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.799827 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800049 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800139 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800360 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800456 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800668 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800757 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.800976 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801066 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801281 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801371 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801586 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801675 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801893 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.801989 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.802214 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.802303 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.802533 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.802631 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.802836 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.802928 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.803155 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.803243 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.803491 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.803594 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.803806 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.803895 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.804116 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.804205 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.804422 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.804519 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.804668 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:49:09.804756 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.805044 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.805348 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.805657 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.805957 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.806261 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.806570 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.806878 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.807198 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.807548 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.807851 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.808172 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.808494 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.808838 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.809146 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.809484 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.809809 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.810120 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.810428 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.810730 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:49:09.810970 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:49:09.866592 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Registered counter for database nova_api Jun 14 17:49:09.874864 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Registered counter for database nova_api Jun 14 17:49:09.888875 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:09.897289 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:09.897682 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:09.904455 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:09.955886 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.context [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d139790-d717-4871-b5fc-a36675c1ea79(cell1) {{(pid=110304) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 17:49:09.960058 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:49:09.961628 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:49:09.962451 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:49:09.964268 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.context [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d139790-d717-4871-b5fc-a36675c1ea79(cell1) {{(pid=110303) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 17:49:09.964554 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:49:09.966453 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Registered counter for database nova_cell0 Jun 14 17:49:09.968331 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:49:09.970411 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Registered counter for database nova_cell1 Jun 14 17:49:09.970592 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:49:09.971425 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:49:09.973458 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_concurrency.lockutils [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:49:09.975475 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Registered counter for database nova_cell0 Jun 14 17:49:09.978615 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:09.979456 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Registered counter for database nova_cell1 Jun 14 17:49:09.980467 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:09.986773 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:09.987053 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:09.988432 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:09.988921 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:09.996709 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:09.997041 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:10.136606 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO dbcounter [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Registered counter for database nova_cell0 Jun 14 17:49:10.146317 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_db.sqlalchemy.engines [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:10.150187 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO dbcounter [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Registered counter for database nova_cell0 Jun 14 17:49:10.150969 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writer thread running {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:10.159039 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG oslo_db.sqlalchemy.engines [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:49:10.163788 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writer thread running {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:49:10.615757 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:49:10.619103 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:49:10.623156 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:49:10.628316 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:49:10.972056 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:49:10.973292 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:49:10.978051 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: WARNING keystonemiddleware.auth_token [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:49:10.979543 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: WARNING keystonemiddleware.auth_token [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:49:10.983333 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6190499c0 pid: 110303 (default app) Jun 14 17:49:10.984907 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f6190499c0 pid: 110304 (default app) Jun 14 17:49:10.985521 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:49:10.986787 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-f856bcb8-e66a-4d79-b5de-5f5435736cc7 None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001846 Jun 14 17:49:10.987212 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Tue Jun 14 17:49:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:34.128756 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:34.129990 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jun 14 17:50:34.130397 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:34.143073 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=3 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:34.144072 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell0:SELECT=3 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:34.145004 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell1:SELECT=3 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:34.146181 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:34.667886 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-21f24f2b-203a-474c-af9b-08f9358e5d96 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:34.702730 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-21f24f2b-203a-474c-af9b-08f9358e5d96 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.560596 Jun 14 17:50:34.702730 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 2/3] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 14 17:50:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:36.952368 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:36.953376 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-578eab41-61e9-4224-a68e-22b9479984a6 None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 14 17:50:36.955832 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 2/4] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:37.021826 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-fef6f13a-be86-4351-bc6e-66bf3022d66d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 1, "id": "c1", "ram": 256, "name": "cirros256"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:37.041243 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:50:37.041243 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 14 17:50:37.126038 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-fef6f13a-be86-4351-bc6e-66bf3022d66d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.165818 Jun 14 17:50:37.126843 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 3/5] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 17:50:37.140741 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=3 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:37.141938 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell1:SELECT=3 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:37.142772 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell0:SELECT=3 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:37.143665 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:50:37.355618 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-d040405f-da54-41ab-bc6c-bf3941d4b0bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:37.357971 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:50:37.357971 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 14 17:50:37.476920 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-d040405f-da54-41ab-bc6c-bf3941d4b0bc admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.341806 Jun 14 17:50:37.477826 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 3/6] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 14 17:50:37 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:39.730146 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-fef6f13a-be86-4351-bc6e-66bf3022d66d admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:39.731540 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-fef6f13a-be86-4351-bc6e-66bf3022d66d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001863 Jun 14 17:50:39.731993 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 4/7] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:39.872145 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-2907cacd-f458-44d9-b7aa-03931c1aeaf1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "ram": 512}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:39.892904 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:50:39.892904 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 14 17:50:39.992175 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-2907cacd-f458-44d9-b7aa-03931c1aeaf1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.253164 Jun 14 17:50:39.993625 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 4/8] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 17:50:40.007806 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-b2ebb310-dd14-449e-8daa-1dbc2de0990a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:40.009447 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:50:40.009447 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: warnings.warn(msg) Jun 14 17:50:40.198078 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-b2ebb310-dd14-449e-8daa-1dbc2de0990a admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.193964 Jun 14 17:50:40.198736 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 5/9] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 14 17:50:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:42.446357 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-2907cacd-f458-44d9-b7aa-03931c1aeaf1 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:42.447481 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-2907cacd-f458-44d9-b7aa-03931c1aeaf1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 14 17:50:42.448163 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:42.516015 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-5a1582ec-74be-4e34-897e-092e460cf2d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:42.601135 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-5a1582ec-74be-4e34-897e-092e460cf2d7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146278 Jun 14 17:50:42.602157 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 6/11] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:50:42.615243 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-087a51e6-50eb-4253-b8e5-f93d7a8816c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:42.770916 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-087a51e6-50eb-4253-b8e5-f93d7a8816c7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159523 Jun 14 17:50:42.771724 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 6/12] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 14 17:50:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:45.101501 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-5a1582ec-74be-4e34-897e-092e460cf2d7 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:45.102588 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-5a1582ec-74be-4e34-897e-092e460cf2d7 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Jun 14 17:50:45.103107 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 7/13] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:45.174958 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-568a06e6-17ca-4139-b4fc-492635390538 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "id": "d3", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:45.284974 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-568a06e6-17ca-4139-b4fc-492635390538 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172008 Jun 14 17:50:45.285440 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 7/14] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:50:45.298308 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-c2c7372b-879b-4a81-b2f0-bf458a09a86c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:45.409467 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-c2c7372b-879b-4a81-b2f0-bf458a09a86c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115386 Jun 14 17:50:45.410063 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 8/15] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 14 17:50:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:47.703861 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-568a06e6-17ca-4139-b4fc-492635390538 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:47.704872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-568a06e6-17ca-4139-b4fc-492635390538 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 14 17:50:47.705804 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 8/16] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:47.770246 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-0a61a9a8-b37d-4b6a-8c3d-7ca3f39cb313 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "ram": 4096, "swap": 0}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:47.879548 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-0a61a9a8-b37d-4b6a-8c3d-7ca3f39cb313 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165895 Jun 14 17:50:47.880011 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 9/17] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 17:50:47.892206 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-d60a8c38-af5f-4e66-855f-1fc5c29631a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:48.007178 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-d60a8c38-af5f-4e66-855f-1fc5c29631a6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118663 Jun 14 17:50:48.008283 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 9/18] 10.222.0.36 () {64 vars in 1335 bytes} [Tue Jun 14 17:50:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:50.249904 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-0a61a9a8-b37d-4b6a-8c3d-7ca3f39cb313 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:50.251049 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-0a61a9a8-b37d-4b6a-8c3d-7ca3f39cb313 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jun 14 17:50:50.251897 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 10/19] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:50.321886 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-7513ad48-dfa5-41d5-ab19-ce5e41d325a4 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:50.347698 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-7513ad48-dfa5-41d5-ab19-ce5e41d325a4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088733 Jun 14 17:50:50.348353 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 10/20] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 14 17:50:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:50:52.768739 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-0a61a9a8-b37d-4b6a-8c3d-7ca3f39cb313 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:52.770095 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-0a61a9a8-b37d-4b6a-8c3d-7ca3f39cb313 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Jun 14 17:50:52.770641 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:52.833894 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-aa0e448f-f3cf-452f-b074-ab3ca1cbc8a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "1", "name": "m1.tiny"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:52.924767 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-aa0e448f-f3cf-452f-b074-ab3ca1cbc8a1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.147947 Jun 14 17:50:52.925465 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 11/22] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:50:52.940566 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8051ac68-65ce-47bd-8883-5205b03a092b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:53.043473 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8051ac68-65ce-47bd-8883-5205b03a092b admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109303 Jun 14 17:50:53.045197 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 12/23] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 14 17:50:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:55.351338 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-aa0e448f-f3cf-452f-b074-ab3ca1cbc8a1 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:55.353240 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-aa0e448f-f3cf-452f-b074-ab3ca1cbc8a1 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002430 Jun 14 17:50:55.354780 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 12/24] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:55 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:55.424699 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-09114978-98a9-4f78-80b2-67c5ba30b0a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "vcpus": 1, "swap": 0}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:55.535799 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-09114978-98a9-4f78-80b2-67c5ba30b0a9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.174338 Jun 14 17:50:55.536580 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 13/25] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:50:55.549789 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-b18e34eb-fd7e-4868-90c5-70908e23c5d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:55.643341 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-b18e34eb-fd7e-4868-90c5-70908e23c5d7 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098109 Jun 14 17:50:55.643939 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 13/26] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 14 17:50:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:50:57.902870 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-09114978-98a9-4f78-80b2-67c5ba30b0a9 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:50:57.903988 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-09114978-98a9-4f78-80b2-67c5ba30b0a9 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jun 14 17:50:57.904611 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 14/27] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:50:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:50:57.967761 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-88a1ebf7-f765-49a6-bdf6-b133f7d48460 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "disk": 40, "id": "3", "ram": 4096, "swap": 0}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:58.055315 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-88a1ebf7-f765-49a6-bdf6-b133f7d48460 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.144759 Jun 14 17:50:58.055880 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 14/28] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:50:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 17:50:58.069809 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-7e0b0591-7d2d-4131-a5ef-c47c0f6a05d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:50:58.162454 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-7e0b0591-7d2d-4131-a5ef-c47c0f6a05d1 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096569 Jun 14 17:50:58.163057 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 15/29] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 14 17:50:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:51:00.444219 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-88a1ebf7-f765-49a6-bdf6-b133f7d48460 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:00.445638 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-88a1ebf7-f765-49a6-bdf6-b133f7d48460 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001853 Jun 14 17:51:00.446045 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 15/30] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:51:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:00.511634 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-a6f4f439-bc0c-4698-9420-db6ed9386c08 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:00.740133 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-a6f4f439-bc0c-4698-9420-db6ed9386c08 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.287282 Jun 14 17:51:00.740691 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 16/31] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:51:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 17:51:00.752615 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-18b1e8c3-e7f1-4e47-8500-e21056c44c09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:00.871076 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-18b1e8c3-e7f1-4e47-8500-e21056c44c09 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122108 Jun 14 17:51:00.872222 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 14 17:51:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:51:03.214554 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-a6f4f439-bc0c-4698-9420-db6ed9386c08 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:03.216593 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-a6f4f439-bc0c-4698-9420-db6ed9386c08 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Jun 14 17:51:03.216712 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:51:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:03.313372 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-7094fae4-240b-4f4a-8f92-4aeb3a78bd3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:03.464845 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-7094fae4-240b-4f4a-8f92-4aeb3a78bd3d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.240883 Jun 14 17:51:03.467420 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 17/34] 10.222.0.36 () {64 vars in 1282 bytes} [Tue Jun 14 17:51:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 17:51:03.487623 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-d0810416-11db-42f8-8d8b-2d32d2a3ff71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:04.244742 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:04.252856 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-d0810416-11db-42f8-8d8b-2d32d2a3ff71 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.769345 Jun 14 17:51:04.268204 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 18/35] 10.222.0.36 () {64 vars in 1332 bytes} [Tue Jun 14 17:51:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:51:29.459071 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-7094fae4-240b-4f4a-8f92-4aeb3a78bd3d admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:29.460539 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-7094fae4-240b-4f4a-8f92-4aeb3a78bd3d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002080 Jun 14 17:51:29.461106 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:51:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:29.525312 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-e2d986da-49e5-4584-8da5-9905803fb1a1 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:29.544634 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-e2d986da-49e5-4584-8da5-9905803fb1a1 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.076704 Jun 14 17:51:29.548596 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 14 17:51:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:51:30.557797 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-7094fae4-240b-4f4a-8f92-4aeb3a78bd3d admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:30.559720 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-7094fae4-240b-4f4a-8f92-4aeb3a78bd3d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 Jun 14 17:51:30.560151 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:30.773833 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3b76e7e3-381b-47ae-b4be-c99e9420ff92 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:30.780364 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.wsgi [None req-3b76e7e3-381b-47ae-b4be-c99e9420ff92 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3b76e7e3-381b-47ae-b4be-c99e9420ff92 admin admin] Request method failure captured: Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Accept: application/json Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Accept-Encoding: gzip, deflate Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Connection: keep-alive Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Content-Length: 0 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Host: 10.222.0.36 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Openstack-Api-Version: compute 2.90 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Openstack-System-Scope: None Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: User-Agent: python-novaclient Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Auth-Token: gAAAAABiqMqivXVOtUkUdtIxObOdF7t7imXtBFxWpiTSZTO1Qob1ErvAhRwMqJM1ZhUDzuWoTpOXtefszMXio68pGqgUtXYCOa9GVTu36xkgiTv4UN7bqGuoql_iYIuxz1Qcp_LUuQocQcTwFLj9uxifyDGPGV70DjeMDl40n0-M2gM_5CPKYG0 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Domain-Id: None Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Domain-Name: None Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Identity-Status: Confirmed Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Is-Admin-Project: True Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Domain-Id: default Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Domain-Name: Default Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Name: admin Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Role: admin,reader,member Jun 14 17:51:30.783694 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Roles: admin,reader,member Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f37a5c2ee2664dafb5a29dda0a1fc6e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant: admin Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant-Name: admin Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User: admin Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Domain-Id: default Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Domain-Name: Default Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Id: bdaeb72186c0489e804154d6d26ae21b Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Name: admin Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: method: > Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: exception: Flavor 42 could not be found. Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: action_args: {'id': '42'} Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:51:30.786625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:30.787765 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.789216 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-3b76e7e3-381b-47ae-b4be-c99e9420ff92 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:51:30.790771 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-3b76e7e3-381b-47ae-b4be-c99e9420ff92 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067925 Jun 14 17:51:30.790771 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 20/39] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 14 17:51:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:30.795095 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-86319cf6-24d6-47c3-986f-1aba654ed544 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:30.798126 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:51:30.818011 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-86319cf6-24d6-47c3-986f-1aba654ed544 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026591 Jun 14 17:51:30.818582 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 14 17:51:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:51:30.829391 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-d300dba9-3670-4c6c-b77e-3f4ae3dcee49 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:30.853232 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-d300dba9-3670-4c6c-b77e-3f4ae3dcee49 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027386 Jun 14 17:51:30.853827 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 14 17:51:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:51:30.864721 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-79179ebd-2881-4780-969e-ea2a3f4b4825 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:30.872074 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.wsgi [None req-79179ebd-2881-4780-969e-ea2a3f4b4825 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-79179ebd-2881-4780-969e-ea2a3f4b4825 admin admin] Request method failure captured: Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Accept: application/json Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Accept-Encoding: gzip, deflate Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Connection: keep-alive Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Content-Length: 0 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Host: 10.222.0.36 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Openstack-Api-Version: compute 2.90 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Openstack-System-Scope: None Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: User-Agent: python-novaclient Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Auth-Token: gAAAAABiqMqivXVOtUkUdtIxObOdF7t7imXtBFxWpiTSZTO1Qob1ErvAhRwMqJM1ZhUDzuWoTpOXtefszMXio68pGqgUtXYCOa9GVTu36xkgiTv4UN7bqGuoql_iYIuxz1Qcp_LUuQocQcTwFLj9uxifyDGPGV70DjeMDl40n0-M2gM_5CPKYG0 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Domain-Id: None Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Domain-Name: None Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Identity-Status: Confirmed Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Is-Admin-Project: True Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Domain-Id: default Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Domain-Name: Default Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Name: admin Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Role: admin,reader,member Jun 14 17:51:30.875476 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Roles: admin,reader,member Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f37a5c2ee2664dafb5a29dda0a1fc6e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant: admin Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant-Name: admin Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User: admin Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Domain-Id: default Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Domain-Name: Default Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Id: bdaeb72186c0489e804154d6d26ae21b Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Name: admin Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: method: > Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: exception: Flavor 42 could not be found. Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: action_args: {'id': '42'} Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:51:30.888674 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:30.889634 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:30.890919 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-79179ebd-2881-4780-969e-ea2a3f4b4825 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:51:30.891963 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-79179ebd-2881-4780-969e-ea2a3f4b4825 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016018 Jun 14 17:51:30.891963 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 14 17:51:30 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:31.813448 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-d300dba9-3670-4c6c-b77e-3f4ae3dcee49 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:31.814455 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-d300dba9-3670-4c6c-b77e-3f4ae3dcee49 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 14 17:51:31.814852 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 22/43] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:32.011990 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-5962ef5c-913b-4737-9097-52246b75fa9f admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:32.018343 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.wsgi [None req-5962ef5c-913b-4737-9097-52246b75fa9f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-5962ef5c-913b-4737-9097-52246b75fa9f admin admin] Request method failure captured: Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Accept: application/json Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Accept-Encoding: gzip, deflate Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Connection: keep-alive Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Content-Length: 0 Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Host: 10.222.0.36 Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Openstack-Api-Version: compute 2.90 Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Openstack-System-Scope: None Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: User-Agent: python-novaclient Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Auth-Token: gAAAAABiqMqjRfLRj4-MBwOjKM1fnFkg1X4WZZ8LQ6b_aczmDz9qgJH_HcT5CgNzYjNY_vPuBAGVbYQ_RJuheOpMwWd2hk9DPJZGz4Xv2T-pxDwuw1RklsEE3x4y-5hY6SFBkhZbsP--vqNEnUMNPmxFLD1QmEStlPXOJ4ZEsz7dEKYjXDfj7mQ Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Domain-Id: None Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Domain-Name: None Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Identity-Status: Confirmed Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Is-Admin-Project: True Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Domain-Id: default Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Domain-Name: Default Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Name: admin Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Role: admin,reader,member Jun 14 17:51:32.019872 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Roles: admin,reader,member Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f37a5c2ee2664dafb5a29dda0a1fc6e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant: admin Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant-Name: admin Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User: admin Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Domain-Id: default Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Domain-Name: Default Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Id: bdaeb72186c0489e804154d6d26ae21b Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Name: admin Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: method: > Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: exception: Flavor 84 could not be found. Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: action_args: {'id': '84'} Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:51:32.021320 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:32.022253 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.023700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-5962ef5c-913b-4737-9097-52246b75fa9f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:51:32.024952 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-5962ef5c-913b-4737-9097-52246b75fa9f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065190 Jun 14 17:51:32.024952 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 14 17:51:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:32.031802 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-bd0f261d-91aa-4c99-8fe0-0072b49820fe admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:32.047909 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-bd0f261d-91aa-4c99-8fe0-0072b49820fe admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020400 Jun 14 17:51:32.048471 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 14 17:51:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:51:32.058852 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-7121b175-2b55-4f2d-b7aa-c84101abe700 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:32.075942 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-7121b175-2b55-4f2d-b7aa-c84101abe700 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021335 Jun 14 17:51:32.076499 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 14 17:51:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:51:32.086393 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-818dbe59-c1f2-4e3d-8f8e-c3c9daa14dea admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:32.092818 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.wsgi [None req-818dbe59-c1f2-4e3d-8f8e-c3c9daa14dea admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-818dbe59-c1f2-4e3d-8f8e-c3c9daa14dea admin admin] Request method failure captured: Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Accept: application/json Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Accept-Encoding: gzip, deflate Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Connection: keep-alive Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Content-Length: 0 Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Host: 10.222.0.36 Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Openstack-Api-Version: compute 2.90 Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Openstack-System-Scope: None Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: User-Agent: python-novaclient Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Auth-Token: gAAAAABiqMqjRfLRj4-MBwOjKM1fnFkg1X4WZZ8LQ6b_aczmDz9qgJH_HcT5CgNzYjNY_vPuBAGVbYQ_RJuheOpMwWd2hk9DPJZGz4Xv2T-pxDwuw1RklsEE3x4y-5hY6SFBkhZbsP--vqNEnUMNPmxFLD1QmEStlPXOJ4ZEsz7dEKYjXDfj7mQ Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Domain-Id: None Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Domain-Name: None Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Identity-Status: Confirmed Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Is-Admin-Project: True Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Domain-Id: default Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Domain-Name: Default Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Name: admin Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Role: admin,reader,member Jun 14 17:51:32.094353 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Roles: admin,reader,member Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f37a5c2ee2664dafb5a29dda0a1fc6e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant: admin Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant-Name: admin Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User: admin Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Domain-Id: default Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Domain-Name: Default Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Id: bdaeb72186c0489e804154d6d26ae21b Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Name: admin Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: method: > Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: exception: Flavor 84 could not be found. Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: action_args: {'id': '84'} Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:51:32.096087 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:32.097002 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:32.098332 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-818dbe59-c1f2-4e3d-8f8e-c3c9daa14dea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:51:32.099555 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-818dbe59-c1f2-4e3d-8f8e-c3c9daa14dea admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013017 Jun 14 17:51:32.099555 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 24/47] 10.222.0.36 () {60 vars in 1190 bytes} [Tue Jun 14 17:51:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:32.999342 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-7121b175-2b55-4f2d-b7aa-c84101abe700 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:33.000355 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-7121b175-2b55-4f2d-b7aa-c84101abe700 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 14 17:51:33.000759 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:33.199614 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-e8229ecc-a49b-437c-9f35-1da01d9c50a3 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:33.205917 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.wsgi [None req-e8229ecc-a49b-437c-9f35-1da01d9c50a3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-e8229ecc-a49b-437c-9f35-1da01d9c50a3 admin admin] Request method failure captured: Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Accept: application/json Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Accept-Encoding: gzip, deflate Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Connection: keep-alive Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Content-Length: 0 Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Host: 10.222.0.36 Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Openstack-Api-Version: compute 2.90 Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Openstack-System-Scope: None Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: User-Agent: python-novaclient Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Auth-Token: gAAAAABiqMqkl4R3bpYk71OWEGln_qfV3fNuzicK8QKnH0BZT8mQJSIt7UVLed4xfQM25sE2yabWGBQGKGIU3C1o30kFDFQgNfT4CLZFVa7U5wxXzf3rYX6Stqxi55RNOemt8mbrNuQ4iXCcRqFhmVbPMNjsrIQKO4ocp0iKvwgo6LTrJ1QzW_M Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Domain-Id: None Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Domain-Name: None Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Identity-Status: Confirmed Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Is-Admin-Project: True Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Domain-Id: default Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Domain-Name: Default Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Project-Name: admin Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Role: admin,reader,member Jun 14 17:51:33.207523 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Roles: admin,reader,member Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f37a5c2ee2664dafb5a29dda0a1fc6e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant: admin Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-Tenant-Name: admin Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User: admin Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Domain-Id: default Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Domain-Name: Default Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Id: bdaeb72186c0489e804154d6d26ae21b Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: X-User-Name: admin Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: method: > Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: exception: Flavor 451 could not be found. Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: action_args: {'id': '451'} Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:51:33.208903 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:33.209710 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.210844 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-e8229ecc-a49b-437c-9f35-1da01d9c50a3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:51:33.211932 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-e8229ecc-a49b-437c-9f35-1da01d9c50a3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067457 Jun 14 17:51:33.211932 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 25/49] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 14 17:51:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:33.219162 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-435b0bc4-7fde-46d6-b88c-4f841a73ec6d admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:33.233492 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-435b0bc4-7fde-46d6-b88c-4f841a73ec6d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017911 Jun 14 17:51:33.234054 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 25/50] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 14 17:51:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 17:51:33.244299 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:33.258840 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018373 Jun 14 17:51:33.263625 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 26/51] 10.222.0.36 () {60 vars in 1210 bytes} [Tue Jun 14 17:51:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:51:33.272370 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-b0ccf139-0914-439a-a09b-9052daa64837 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:33.278046 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.wsgi [None req-b0ccf139-0914-439a-a09b-9052daa64837 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-b0ccf139-0914-439a-a09b-9052daa64837 admin admin] Request method failure captured: Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Accept: application/json Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Accept-Encoding: gzip, deflate Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Connection: keep-alive Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Content-Length: 0 Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Host: 10.222.0.36 Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Openstack-Api-Version: compute 2.90 Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Openstack-System-Scope: None Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: User-Agent: python-novaclient Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Auth-Token: gAAAAABiqMqkl4R3bpYk71OWEGln_qfV3fNuzicK8QKnH0BZT8mQJSIt7UVLed4xfQM25sE2yabWGBQGKGIU3C1o30kFDFQgNfT4CLZFVa7U5wxXzf3rYX6Stqxi55RNOemt8mbrNuQ4iXCcRqFhmVbPMNjsrIQKO4ocp0iKvwgo6LTrJ1QzW_M Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Domain-Id: None Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Domain-Name: None Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Identity-Status: Confirmed Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Is-Admin-Project: True Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Openstack-Nova-Api-Version: 2.90 Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Domain-Id: default Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Domain-Name: Default Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Project-Name: admin Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Role: admin,reader,member Jun 14 17:51:33.279607 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Roles: admin,reader,member Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f37a5c2ee2664dafb5a29dda0a1fc6e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f37a5c2ee2664dafb5a29dda0a1fc6e2", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant: admin Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant-Id: f37a5c2ee2664dafb5a29dda0a1fc6e2 Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-Tenant-Name: admin Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User: admin Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Domain-Id: default Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Domain-Name: Default Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Id: bdaeb72186c0489e804154d6d26ae21b Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: X-User-Name: admin Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: method: > Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: exception: Flavor 451 could not be found. Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: action_args: {'id': '451'} Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:51:33.281105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:33.282500 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: ERROR nova.api.openstack.wsgi Jun 14 17:51:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-b0ccf139-0914-439a-a09b-9052daa64837 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:51:33.284864 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-b0ccf139-0914-439a-a09b-9052daa64837 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012347 Jun 14 17:51:33.284864 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 26/52] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 14 17:51:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 14 17:51:34.207200 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:34.208259 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 14 17:51:34.208671 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 27/53] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:51:34.406977 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-bcdb045b-af33-44e1-826c-02590c8c669c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:34.501870 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-bcdb045b-af33-44e1-826c-02590c8c669c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.150742 Jun 14 17:51:34.503383 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 27/54] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 14 17:51:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:51:35.395165 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:35.396313 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jun 14 17:51:35.396717 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:35.591134 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-f126d8fb-a478-47fa-9642-3b172f2edc4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:35.693908 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-f126d8fb-a478-47fa-9642-3b172f2edc4d admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.156600 Jun 14 17:51:35.694482 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 28/56] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 14 17:51:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:51:36.600840 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:36.601873 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 14 17:51:36.602290 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 29/57] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:36.797846 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-c351d926-fe3c-45ee-b767-8fa1bd6f6000 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:36.871612 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-c351d926-fe3c-45ee-b767-8fa1bd6f6000 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.128351 Jun 14 17:51:36.872075 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 29/58] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 14 17:51:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:51:37.757695 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:37.758696 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 14 17:51:37.759093 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:51:37.953650 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-ba17f970-5f33-48e0-b237-a52633b54cd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:51:38.049016 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-ba17f970-5f33-48e0-b237-a52633b54cd3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.149406 Jun 14 17:51:38.049560 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 30/60] 10.222.0.36 () {64 vars in 1235 bytes} [Tue Jun 14 17:51:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:51:38.950368 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:38.951660 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 14 17:51:38.953452 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 31/61] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:51:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:51:39.148626 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-d8904953-b339-4750-85a4-897eda4f621f admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:51:39.169120 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-d8904953-b339-4750-85a4-897eda4f621f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074435 Jun 14 17:51:39.169667 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 31/62] 10.222.0.36 () {60 vars in 1202 bytes} [Tue Jun 14 17:51:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:52:29.704878 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:52:29.705927 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-26216063-e423-45b3-b3d3-2a7a1c3e35ff admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 14 17:52:29.706364 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 32/63] 10.222.0.36 () {54 vars in 930 bytes} [Tue Jun 14 17:52:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:52:29.717610 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:29.769569 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-cbcf3102-f7c0-4c96-98d0-d4d277b8e7e9 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:52:29.789838 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-cbcf3102-f7c0-4c96-98d0-d4d277b8e7e9 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076696 Jun 14 17:52:29.791093 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 32/64] 10.222.0.36 () {60 vars in 1291 bytes} [Tue Jun 14 17:52:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:52:29.815524 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-49d2b225-dc94-4e85-80f9-9411df065bb6 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:52:29.818960 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG dbcounter [-] [110303] Writing DB stats nova_api:SELECT=15 {{(pid=110303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:52:29.824156 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-49d2b225-dc94-4e85-80f9-9411df065bb6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012422 Jun 14 17:52:29.824723 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 33/65] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jun 14 17:52:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:52:29.836623 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-be262b8d-95a6-4d60-be90-65ab985ea6b2 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:52:29.846402 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-be262b8d-95a6-4d60-be90-65ab985ea6b2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013522 Jun 14 17:52:29.846945 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 33/66] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jun 14 17:52:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:52:29.860132 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:52:29.869302 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012575 Jun 14 17:52:29.869886 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 34/67] 10.222.0.36 () {60 vars in 1285 bytes} [Tue Jun 14 17:52:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:52:29.881706 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-e396322a-2a13-4ad1-98b1-3334af02ca3f admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:52:29.890828 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-e396322a-2a13-4ad1-98b1-3334af02ca3f admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012501 Jun 14 17:52:29.891816 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 34/68] 10.222.0.36 () {60 vars in 1282 bytes} [Tue Jun 14 17:52:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:56:08.436570 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:08.437630 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 14 17:56:08.438050 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:56:08.600105 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=6 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:08.719828 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-3281c10f-d0ea-4d19-a88b-615074b613e4 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:08.721001 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:08.721001 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 14 17:56:08.722229 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-3281c10f-d0ea-4d19-a88b-615074b613e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:08.723177 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-3281c10f-d0ea-4d19-a88b-615074b613e4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:08.723999 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-3281c10f-d0ea-4d19-a88b-615074b613e4 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:08.724423 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-3281c10f-d0ea-4d19-a88b-615074b613e4 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:08.759090 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-3281c10f-d0ea-4d19-a88b-615074b613e4 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.160466 Jun 14 17:56:08.759689 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 35/70] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 14 17:56:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:56:09.657508 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:09.658516 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 14 17:56:09.658911 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 36/71] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:56:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:56:09.856203 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-4e12ff93-c0e1-4bfe-ac66-8aed9b4207c1 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:09.857397 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:09.857397 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 14 17:56:09.858590 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-4e12ff93-c0e1-4bfe-ac66-8aed9b4207c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:09.859034 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-4e12ff93-c0e1-4bfe-ac66-8aed9b4207c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:09.859852 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-4e12ff93-c0e1-4bfe-ac66-8aed9b4207c1 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:09.860283 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-4e12ff93-c0e1-4bfe-ac66-8aed9b4207c1 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:09.880948 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-4e12ff93-c0e1-4bfe-ac66-8aed9b4207c1 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080883 Jun 14 17:56:09.881446 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 36/72] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 14 17:56:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:56:21.231074 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:21.232112 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 14 17:56:21.232510 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:56:21.385673 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell0:SELECT=4 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:21.386415 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_cell1:SELECT=4 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:21.387285 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG dbcounter [-] [110304] Writing DB stats nova_api:SELECT=8 {{(pid=110304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:56:21.438230 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-726d2530-a8b1-4ac5-b701-e349b2bc2381 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:21.439366 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:21.439366 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 14 17:56:21.440538 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-726d2530-a8b1-4ac5-b701-e349b2bc2381 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:21.441029 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-726d2530-a8b1-4ac5-b701-e349b2bc2381 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:21.441820 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-726d2530-a8b1-4ac5-b701-e349b2bc2381 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:21.442245 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-726d2530-a8b1-4ac5-b701-e349b2bc2381 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:21.467388 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-726d2530-a8b1-4ac5-b701-e349b2bc2381 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091815 Jun 14 17:56:21.467953 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 37/74] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 14 17:56:21 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:56:22.351873 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: DEBUG nova.api.openstack.wsgi [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] Calling method '>' {{(pid=110303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:22.352822 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: INFO nova.api.openstack.requestlog [None req-8f1cb79d-4ded-4184-9dfc-afffdcdf5562 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 14 17:56:22.353218 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: [pid: 110303|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1074 bytes} [Tue Jun 14 17:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:56:22.557098 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG nova.api.openstack.wsgi [None req-5cb9126e-c57c-4010-8905-b78395dee305 admin admin] Calling method '>' {{(pid=110304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:56:22.558298 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 17:56:22.558298 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: warnings.warn(msg) Jun 14 17:56:22.559519 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-5cb9126e-c57c-4010-8905-b78395dee305 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:22.559964 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-5cb9126e-c57c-4010-8905-b78395dee305 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:22.560742 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-5cb9126e-c57c-4010-8905-b78395dee305 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:56:22.561175 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: DEBUG oslo_concurrency.lockutils [None req-5cb9126e-c57c-4010-8905-b78395dee305 admin admin] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:56:22.583157 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: INFO nova.api.openstack.requestlog [None req-5cb9126e-c57c-4010-8905-b78395dee305 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081152 Jun 14 17:56:22.583752 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: [pid: 110304|app: 0|req: 38/76] 10.222.0.36 () {60 vars in 1193 bytes} [Tue Jun 14 17:56:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:57:19.039891 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: Tue Jun 14 17:57:19 2022 - graceful shutdown triggered... Jun 14 17:57:19.040018 dv-cinder-826350-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 14 17:57:19.041176 dv-cinder-826350-5-iscsi devstack@n-api.service[110303]: Gracefully killing worker 1 (pid: 110303)... Jun 14 17:57:19.041567 dv-cinder-826350-5-iscsi devstack@n-api.service[110304]: Gracefully killing worker 2 (pid: 110304)... Jun 14 17:57:20.042437 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: worker 1 buried after 1 seconds Jun 14 17:57:20.042437 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: worker 2 buried after 1 seconds Jun 14 17:57:20.042437 dv-cinder-826350-5-iscsi devstack@n-api.service[110302]: goodbye to uWSGI. Jun 14 17:57:20.044007 dv-cinder-826350-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 14 17:57:20.044573 dv-cinder-826350-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 14 17:57:20.047266 dv-cinder-826350-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 14 17:57:20.062419 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 17:57:20 2022] *** Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: nodename: dv-cinder-826350-5-iscsi Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: machine: x86_64 Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: clock source: unix Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: pcre jit disabled Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: detected number of CPU cores: 4 Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: current working directory: / Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: detected binary path: /usr/bin/uwsgi-core Jun 14 17:57:20.064250 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: your processes number limit is 47680 Jun 14 17:57:20.068612 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: your memory page size is 4096 bytes Jun 14 17:57:20.068612 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: detected max file descriptor number: 2048 Jun 14 17:57:20.068612 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: lock engine: pthread robust mutexes Jun 14 17:57:20.068612 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: thunder lock: enabled Jun 14 17:57:20.068612 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 14 17:57:20.068612 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 17:57:20.110223 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: Python main interpreter initialized at 0x5560928949c0 Jun 14 17:57:20.110223 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: python threads support enabled Jun 14 17:57:20.110223 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: your server socket listen backlog is limited to 100 connections Jun 14 17:57:20.110223 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: your mercy for graceful operations on workers is 90 seconds Jun 14 17:57:20.110677 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 17:57:20.110677 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: *** Operational MODE: preforking *** Jun 14 17:57:20.111014 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: *** uWSGI is running in multiple interpreter mode *** Jun 14 17:57:20.111014 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: spawned uWSGI master process (pid: 125141) Jun 14 17:57:20.111227 dv-cinder-826350-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 14 17:57:20.111876 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: spawned uWSGI worker 1 (pid: 125161, cores: 1) Jun 14 17:57:20.114241 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: spawned uWSGI worker 2 (pid: 125162, cores: 1) Jun 14 17:57:20.114241 dv-cinder-826350-5-iscsi devstack@n-api.service[125141]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 17:57:20.792402 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 17:57:20.795887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 14 17:57:22.062529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:57:22.062529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: from cryptography.utils import int_from_bytes Jun 14 17:57:22.063261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:57:22.063261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: from cryptography.utils import int_from_bytes Jun 14 17:57:22.078290 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:57:22.078290 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: from cryptography.utils import int_from_bytes Jun 14 17:57:22.078883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 17:57:22.078883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: from cryptography.utils import int_from_bytes Jun 14 17:57:24.527748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.533931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-5-iscsi {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.534564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.534564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.534564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.534564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.534564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.534953 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.535049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.535542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.535986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.536301 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.536630 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.538198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.538198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.538198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.538198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.538198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.538678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.539366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.539366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-5-iscsi {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.539547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.539911 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.540161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.540561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.540902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.541194 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.541517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.542382 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.542709 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.543036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.543392 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.543721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.544044 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.544386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.544667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.544981 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.545306 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.545824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.546184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.546441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.546933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.547216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 17:57:24.547687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 17:57:24.547780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.547964 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.548069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 17:57:24.548234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.548401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 17:57:24.548508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.548665 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 17:57:24.548768 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549033 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549423 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549686 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.549976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.550082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.550291 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.550416 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.550607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.550711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.550906 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.551010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.551222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.551361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.551562 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.551750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.551904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552070 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826350-5-iscsi {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.552972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553416 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553638 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.553965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.554121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.554238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.554545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.554693 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.554989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.555101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.555262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.555469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.555607 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.555759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.555968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.556219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.556335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.556426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.556601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.556721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.556912 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.557123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.557225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.557320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.557582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.558506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826350-5-iscsi {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.559976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.560157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.560292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.560574 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.560667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.560889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561271 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561372 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561822 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.561927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.562122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.562233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.562421 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.562518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.562763 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.562873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.563050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.563156 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.563391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.563552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.563764 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.563960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564059 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564306 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564410 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.564941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565494 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.565907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.566129 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.566228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.566435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.566537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.566758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.566856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567259 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567708 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.567928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568028 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568339 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568547 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.568947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.569162 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.569254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.569469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.569574 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.569777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.569879 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.570083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.570182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.570392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.570485 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.570698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.570798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571106 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571661 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.571979 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.573159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.573358 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.573908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574031 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574737 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.574923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575015 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575245 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575356 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575461 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575559 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575650 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.575824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.575960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.576058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.576156 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.576240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.576378 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.576474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.576558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.576652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.576746 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.576981 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.577082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.577305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.577403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.577620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.577714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.577936 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.578034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.578245 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.578347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.578552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.578651 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.578853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.578945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.579165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.579330 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.579501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.579620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.579811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.580122 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.580433 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.580606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.580773 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.580929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.581025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.581259 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.581367 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.581587 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.581688 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.581914 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.582016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.582236 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.582344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.582539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.582647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.582854 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.582971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.583145 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.583244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.583469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.583597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.584020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.584157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.584440 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.584568 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.584662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.584745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.584977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.585147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.585305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.585488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.585639 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.585740 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.585928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.586238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.586352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.586552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.586655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.586876 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.586992 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.587179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.587350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.587516 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.587646 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.587835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.587973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.588146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.588297 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.588456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.588617 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.588832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.589131 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.589609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.589699 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.589797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.589896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.589987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.590129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.590235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.590380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.590474 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.590679 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.590770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.591000 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.591106 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.591339 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.591435 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.591654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.591746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.591964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.592058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.592272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.592363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.592583 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.592675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 17:57:24.592895 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.592989 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.593207 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.593306 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.593526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.593628 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.593929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594047 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594263 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594494 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.594958 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.595123 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.595216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.595468 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.595586 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.595796 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.595889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.596108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.596200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.596423 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.596527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.596731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.596822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597143 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.597994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.598091 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.598314 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.598479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.598621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.598712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.598929 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.599018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.599244 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.599397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.599580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.599682 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.599901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600001 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600208 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600524 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600840 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.600933 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.601166 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.601266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.601487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.601584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.601802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.601907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.602114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.602204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.602426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.602525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.602740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.602893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.603061 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.603201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.603414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.603567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.603719 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.603890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.604045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.604142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.604347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605700 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605793 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605884 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.605975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.606068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.606165 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.606380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.606517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.606684 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.606777 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607096 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607332 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607657 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607750 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.607961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608053 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608585 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.608984 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.609195 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.609286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.609500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.609598 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.609808 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.609900 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.610118 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.610268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.610441 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.610562 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.610769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.610876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.611077 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.611182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.611443 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.611571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.611751 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.611866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612161 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.612981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.613090 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.613296 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.613411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.613611 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.613825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.613976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.614229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.614541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.614849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.615174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.615518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.615800 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.615921 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.616126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.616252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.616440 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.616653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.616781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617671 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.617985 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.618114 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.618300 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.618421 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.618636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.618755 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.618974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.619105 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.619276 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.619601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.619780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.619930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.620705 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.621394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.621546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.621707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.621858 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622008 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.622896 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.623050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.623199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.623435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.623593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.623743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.623905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624980 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.624980 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.625254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.625419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.625419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.625727 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.625877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626176 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.626929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627078 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627834 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.627982 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.628510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.628693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.628693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.628987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.629142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.629298 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.629446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.629628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.629786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.629946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.630107 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.630256 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.630443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.630688 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.630863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.631024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.631180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.631408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.631654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.631818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.631968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.632117 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.632284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.632284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.632589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.632589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.632871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633030 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.633937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.634093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.634248 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.634408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.634563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.634725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.634881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.635049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.635206 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.635391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.635554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.636111 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.636284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.636434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.636599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.636599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.636889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.637045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.637208 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.637208 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.637521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.637931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.638089 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.638237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.638386 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.638543 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.638704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.638860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639816 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.639964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.640119 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.640276 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.640435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.640591 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.640591 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.640871 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641019 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641174 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641335 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.641973 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.642128 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.642292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.642449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.642598 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.642753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.642902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.643049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.643207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.643379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.643536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.643706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.643863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644173 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644321 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.644945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.645101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.645101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.645407 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.645566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.645726 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.645882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646194 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.646973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.647129 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.647129 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.647440 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.647612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.647762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.647909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648057 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.648990 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.649147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.649303 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.649450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.649608 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.649777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.649948 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.650097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.650244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.650398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.650554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.650702 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.650865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.651020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.651175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.651550 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.651762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.651934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652185 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652302 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652398 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652489 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652681 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.652975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653071 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653071 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653332 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.653955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654046 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654131 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654516 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.654620 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655841 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.655980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.656049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.656133 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.656217 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.656290 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.656861 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.656971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657428 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657521 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.657977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658617 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658796 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.658876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.659387 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.659507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.659658 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.659742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.659958 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.660957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.661267 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.661575 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.661866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662190 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662498 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.662931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.663124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.663324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.663469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.663672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.663773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664001 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.664984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.665098 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.665290 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.665394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.665607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.665699 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.665921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.666012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.666231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.666325 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.666543 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.666645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.667418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.667682 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668202 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668303 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668482 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668662 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.668843 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.669028 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.669129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.669343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.669660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.669763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.669973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.670071 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.670291 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.670424 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.670595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.670698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.670912 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671018 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671350 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671556 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.671971 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.672174 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.672277 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.672486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.672595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.672804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.672908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.673113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.673210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.673419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.673523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.673730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.673836 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674679 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674783 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.674994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.675105 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.675325 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.675497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.675636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.675830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.675952 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.676156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.676262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.676476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.676570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.676792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.676893 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.677109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.677212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.677419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.677520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.677741 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.677880 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.678984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.679084 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.679477 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.679667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.679797 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.679901 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.680114 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.680216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.680437 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.680549 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.680751 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.680859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.681077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.681168 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.681387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.681479 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.681690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.681783 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.682005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.682099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.682314 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.682407 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.683731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.683844 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.683946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684032 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684307 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684538 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684642 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.684822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685382 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685778 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.685961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.686082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.686271 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.686409 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.686602 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.686732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.686919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.687047 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.687387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.687568 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.687688 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.687813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.687936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.688986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.689176 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.689296 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.689507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.689826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.690150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.690476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.690785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.691101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.691448 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.691731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.691851 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.692056 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.692158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.692370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.692486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.692743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.692968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.693069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.693310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.693417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.693634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.693734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.693962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.694070 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.694262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.694368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.694579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.694678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.694893 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.695001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.695207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.695439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.695534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.695761 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.695861 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.696080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.696186 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.696409 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.696517 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.696718 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.696818 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697030 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697440 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697744 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.697960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.698058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.698305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.698403 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.698740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.699048 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.699231 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.699427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.699745 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.699856 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.700214 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.700320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.700395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.700721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.700912 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.701074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.701227 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.701386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.701537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.701697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.701858 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.702016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.702169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.702320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.702485 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.702644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.702824 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.703069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.703226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.703449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.703614 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.703773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.703925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.704083 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.704243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.704395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.704560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.704712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.704863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705021 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705334 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705499 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705658 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.705960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.706110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.706110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.706419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.706579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.706738 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.706892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.707054 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.707214 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.707414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.707581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.707732 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.707890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708054 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708206 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708843 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.708995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.709156 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.709314 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.709470 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.709629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.709629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.709928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.710079 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.710382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.710382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.710937 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.711119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.711273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.711514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.711691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.711853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712012 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712327 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712630 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.712943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.713187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.713345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.713504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.713657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.713914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.714089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.714310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.714887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.715052 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.715205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.715205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.715546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.715710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.715864 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716489 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.716952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.717114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.717279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.717432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.717591 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.717751 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.717902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.718054 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.718219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.718389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.718549 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.718701 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.718860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.719013 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.719178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.719362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.719536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.719690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.719852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.720012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.720174 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.720326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.720642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.720802 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.720802 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.721233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.721399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.721552 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.721703 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.721863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722181 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722181 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.722955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.723207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.723466 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.723629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.723788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.723941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.724107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.724270 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.724430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.724589 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.724740 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.724911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.725077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.725238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.725391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.725542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.725701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.725853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726013 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726164 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726484 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726646 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.726967 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.727119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.727269 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.727496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.727659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.727820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.727982 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.728142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.728293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.728453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.728604 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.728765 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.728916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.729086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.729238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.729911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.730099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.730281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.730281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.730788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.730954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.731107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.731398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.731398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.731715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.731879 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732351 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732517 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732676 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.732829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.733124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.733284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.733284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.733681 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.733840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.733840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.734145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.734307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.734467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.734627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.734789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.734942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.735094 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.735258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.735469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.735635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.735797 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.735956 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.736126 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.736288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.736442 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.736601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.736761 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.736915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.737080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.737241 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.737393 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.737553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.737714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.737866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738503 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.738978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.739138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.739363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.739796 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.739959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.740138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.740303 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.740466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.740618 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.741010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.741363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.741363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.741784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.741946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.742099 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.742261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.742421 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.742588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.742588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.742907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.743061 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.743214 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.743415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.743573 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.743811 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.743980 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.744141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.744296 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.744457 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.744610 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.744770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.744934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.745152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.745825 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.746057 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.746224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.746378 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.746538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.746691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.746855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.747017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.747170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.747170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.747544 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.747697 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.747697 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.748903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.749206 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.749364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.749537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.749697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.749856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.750016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.750178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.750343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.750628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.751123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.751319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.751484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.751667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.751940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.752110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.752263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.752413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.752565 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.752725 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.752890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.753050 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.753203 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.753655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.754011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.754328 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.754653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.754979 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.755315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.755636 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.755902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.756154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.756329 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.756591 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.756758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.756911 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.757061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.757292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.757445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.757606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.757769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.757923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.758082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.758249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.758401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.758559 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.758756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.758924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.759085 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.759251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.759517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.759830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.760162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.760465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.761528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.761805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.762088 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.762251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.762409 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.762821 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.762996 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.763264 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.763459 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.763623 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.763774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.763937 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.764198 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.764356 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.764508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.764658 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.764817 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.764968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.765133 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.765293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.765452 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.765612 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.765771 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.765921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.766102 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.766263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.766422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.766573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.766724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.766886 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.767037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.767195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.767424 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.767584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.767736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.767900 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.768982 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.769133 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.769282 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.769434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.769720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.770024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.770188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.770340 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.770504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.770707 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.770881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.771035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.771185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.771631 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.771866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.772026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.772308 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.772476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.772631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.772794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.772966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.773118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.773278 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.773431 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.773584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.773735 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.773895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.774057 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.774227 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.774467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.774625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.774785 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.774937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.775112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.775265 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.775473 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.775629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.775780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.775943 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.776240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.776511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.776511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.776818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.776818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.777124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.777124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.777124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.777579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.777738 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.777898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.778060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.778214 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.778365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.778524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.778824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.778981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.779691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.780291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.780483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.780483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.780483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.780483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.781076 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.781237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.781397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.781894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.782146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.782329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.782612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.782770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.782930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.783104 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.783257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.783466 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.783625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.783786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.784339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785348 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.785983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.786287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.786452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.786452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.786452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.786887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.787053 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.787207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.787378 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.787536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.787687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.787837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.788026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.788026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.788333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.788868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.789469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.789645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.789813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.789813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.790760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.791380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.791552 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.792790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.792963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.793118 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.793271 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.793422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.793972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.794571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.795940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.796103 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.796264 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.796425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.796589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.796761 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.796922 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.797074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.797234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.797394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.797547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.797707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.797868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798338 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798656 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798656 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.798978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.799130 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.799281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.799459 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.799610 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.799762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.799925 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.800077 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.800237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.800388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.800538 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.800696 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.800870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.801029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.801188 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.801348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.801509 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.801671 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.801849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.802088 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.802244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.802404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.802678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.803131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.803323 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.803495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.803648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.803799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.803951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804111 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804271 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804430 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804869 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.804869 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.805278 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.805278 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.805592 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.805752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.805921 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.806082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.806234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.806394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.806557 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.806711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.806872 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.807024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.807178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.807401 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.807615 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.808257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.808425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.808606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.808773 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.808927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.809079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.809239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.809403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.809563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.809715 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.809866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.810979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.811257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.811462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.811625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.811787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.811948 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.812208 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.812384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.812549 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.812815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.813299 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.813464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.813633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.813786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.813938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.814089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.814241 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.814398 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.814560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.814724 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.814885 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.815044 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.815197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.815477 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.815651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.815805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.815955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.816116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.816276 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.816436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.816611 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.816771 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.816939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.817099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.817251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.817417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.817572 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.817722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.817881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818041 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818192 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.819736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.819736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.819736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.819736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.819736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.820469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.820469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.820469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.820934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.821086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.821391 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.821707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.822022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.822344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.822657 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.823420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.823596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.823805 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.824135 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.824463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.824780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.825110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.825516 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.825797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.826117 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.826465 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.826794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.827113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.827450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.827760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 17:57:24.828007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 17:57:24.881942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO dbcounter [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Registered counter for database nova_api Jun 14 17:57:24.894460 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO dbcounter [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Registered counter for database nova_api Jun 14 17:57:24.905296 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_db.sqlalchemy.engines [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:24.912735 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writer thread running {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:24.915192 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_db.sqlalchemy.engines [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:24.922139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writer thread running {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:24.973513 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.context [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d139790-d717-4871-b5fc-a36675c1ea79(cell1) {{(pid=125162) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 17:57:24.977855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:57:24.979595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:57:24.980756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.context [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d139790-d717-4871-b5fc-a36675c1ea79(cell1) {{(pid=125161) load_cells /opt/stack/nova/nova/context.py:464}} Jun 14 17:57:24.980921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:57:24.982901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:57:24.984943 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:57:24.985152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO dbcounter [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Registered counter for database nova_cell0 Jun 14 17:57:24.986521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:57:24.987455 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:57:24.988951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO dbcounter [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Registered counter for database nova_cell1 Jun 14 17:57:24.989375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:57:24.991425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO dbcounter [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Registered counter for database nova_cell0 Jun 14 17:57:24.996169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO dbcounter [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Registered counter for database nova_cell1 Jun 14 17:57:24.999273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_db.sqlalchemy.engines [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:25.000152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_db.sqlalchemy.engines [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:25.003677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_db.sqlalchemy.engines [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:25.005342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_db.sqlalchemy.engines [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:25.006333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writer thread running {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:25.009533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writer thread running {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:25.012272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writer thread running {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:25.015183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writer thread running {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:25.166422 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO dbcounter [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Registered counter for database nova_cell0 Jun 14 17:57:25.171770 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO dbcounter [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Registered counter for database nova_cell0 Jun 14 17:57:25.174201 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_db.sqlalchemy.engines [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:25.178292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writer thread running {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:25.178432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_db.sqlalchemy.engines [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 17:57:25.184173 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writer thread running {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 17:57:25.502649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: WARNING keystonemiddleware.auth_token [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:57:25.509957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: WARNING keystonemiddleware.auth_token [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:57:25.519892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: WARNING keystonemiddleware.auth_token [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:57:25.528441 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: WARNING keystonemiddleware.auth_token [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:57:25.860433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: WARNING keystonemiddleware.auth_token [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:57:25.867130 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: WARNING keystonemiddleware.auth_token [None req-acb3eaf3-541e-4fde-b8c5-83db553b5a44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:57:25.873262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5560928949c0 pid: 125162 (default app) Jun 14 17:57:25.884872 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: WARNING keystonemiddleware.auth_token [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 14 17:57:25.892359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: WARNING keystonemiddleware.auth_token [None req-d372b6ce-2afa-4881-b1a1-53d297f96156 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 14 17:57:25.897671 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5560928949c0 pid: 125161 (default app) Jun 14 17:58:08.133532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=3 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:08.135394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=3 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:08.136332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=3 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:08.137279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=3 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.192585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-3f96072c-8095-4ef2-80e0-4f1bd4ddc4b8 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Action: 'create', calling method: .version_select at 0x7fbafe8f0820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-693533691", "metadata": {"Type": "work"}}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:09.451965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1605264d-095c-416f-8355-f77c58534922 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbaff2f89d0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:09.485126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.486487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.487651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:09.489010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:10.627698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1605264d-095c-416f-8355-f77c58534922 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/dfad4720-dd4f-45e0-aebf-d58831263f32" status: 200 len: 351 microversion: 2.1 time: 1.407443 Jun 14 17:58:10.635124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 1/1] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:09 2022] GET /compute/v2.1/os-volumes/dfad4720-dd4f-45e0-aebf-d58831263f32 => generated 351 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:10.968299 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1067790540", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "networks": [{"uuid": "667a5e96-9055-4900-b00c-dabfb3489b5e"}]}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:11.115027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] validate_networks() for [('667a5e96-9055-4900-b00c-dabfb3489b5e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:58:12.042799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-3f96072c-8095-4ef2-80e0-4f1bd4ddc4b8 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.927099 Jun 14 17:58:12.043787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 14 17:58:08 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3931 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 14 17:58:12.056161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-146dca9e-db01-4e95-ba98-ee6f857e9702 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Calling method '.version_select at 0x7fbafe7ba670>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:12.252222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-146dca9e-db01-4e95-ba98-ee6f857e9702 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8" status: 200 len: 352 microversion: 2.1 time: 0.199992 Jun 14 17:58:12.254182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:12 2022] GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 => generated 352 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:12.563471 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:58:12.566518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:58:12.567419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:58:12.568494 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:58:12.568921 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:58:12.587651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:12.589173 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:12.591134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:12.591944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:12.642552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Getting quotas for project a58d8bbe6d8a4352bde684e9878ae6ba. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:12.653097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Getting quotas for user 30552d1e358c41d1b99f22ba59dbd587 and project a58d8bbe6d8a4352bde684e9878ae6ba. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:12.669358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:58:12.678764 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:58:12.881395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-13111596-450b-4b0b-87bf-e2b0cb203ae4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.006420 Jun 14 17:58:12.887681 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 2/4] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 17:58:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 17:58:12.904976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ce016659-9254-4684-9ec9-50929a35a64f tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:12.906745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ce016659-9254-4684-9ec9-50929a35a64f tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:13.113663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ce016659-9254-4684-9ec9-50929a35a64f tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:13.151288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ce016659-9254-4684-9ec9-50929a35a64f tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1215 microversion: 2.1 time: 0.258621 Jun 14 17:58:13.152151 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 3/5] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:12 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:13.268201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-00a0a44d-5e67-43fb-aea8-75d25496a72e tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Calling method '.version_select at 0x7fbafe6db1f0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:13.280452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2ace580c-a01e-438c-bf7a-62db1a33ba6e tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafe78d0d0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:13.466431 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2ace580c-a01e-438c-bf7a-62db1a33ba6e tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/84d46745-6b85-4624-8660-c897e0de74ea" status: 200 len: 350 microversion: 2.1 time: 0.190956 Jun 14 17:58:13.467390 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 4/6] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:13 2022] GET /compute/v2.1/os-volumes/84d46745-6b85-4624-8660-c897e0de74ea => generated 350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:58:13.506912 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-00a0a44d-5e67-43fb-aea8-75d25496a72e tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8" status: 200 len: 353 microversion: 2.1 time: 0.244550 Jun 14 17:58:13.509919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:13 2022] GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 => generated 353 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:13.531386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f08c3f0f-4c72-484f-aa54-70a4cd740b1b tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Calling method '.version_select at 0x7fbafe7984c0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:13.665281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f08c3f0f-4c72-484f-aa54-70a4cd740b1b tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8" status: 200 len: 353 microversion: 2.1 time: 0.141411 Jun 14 17:58:13.665281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:13 2022] GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 => generated 353 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:13.698764 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-00a100fe-c5e5-476d-88fb-3a9d24b74f4e tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Calling method '.version_select at 0x7fbafe6db940>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:14.169190 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8be20255-0dbf-4ec5-969b-1da2b5a07396 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:14.169839 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8be20255-0dbf-4ec5-969b-1da2b5a07396 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:14.197483 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-00a100fe-c5e5-476d-88fb-3a9d24b74f4e tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8" status: 202 len: 0 microversion: 2.1 time: 0.515900 Jun 14 17:58:14.202918 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 4/9] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 17:58:13 2022] DELETE /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 17:58:14.210176 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e85e7c76-8e64-4e03-a637-ad6d27016b2b tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Calling method '.version_select at 0x7fbafd669040>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:14.416260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e85e7c76-8e64-4e03-a637-ad6d27016b2b tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8" status: 200 len: 352 microversion: 2.1 time: 0.212081 Jun 14 17:58:14.416833 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 5/10] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:14 2022] GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 => generated 352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:14.421193 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8be20255-0dbf-4ec5-969b-1da2b5a07396 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:14.429364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8be20255-0dbf-4ec5-969b-1da2b5a07396 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1215 microversion: 2.1 time: 0.263855 Jun 14 17:58:14.444436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:14 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:15.430781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eecf07c4-5dd3-4e9f-95c8-bc442ec671e2 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Calling method '.version_select at 0x7fbafe6dbc10>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:15.451364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7d0b899d-52ea-46a8-b189-b7aaca1be338 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:15.452588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7d0b899d-52ea-46a8-b189-b7aaca1be338 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:15.520648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-eecf07c4-5dd3-4e9f-95c8-bc442ec671e2 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] HTTP exception thrown: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eecf07c4-5dd3-4e9f-95c8-bc442ec671e2 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Request method failure captured: Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 HTTP/1.1 Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMwwE7YmY14Mod53Ql6bYvL4Xe2N_08WyQcGV5CWMI7yBoAbrU37Gu9OkkZVk7fr_12ESL7A_eI1HKaYV6HBdMGKhNGoUak6sMKHWTSxosE6FI-LTpohqCffTDHHdLtmKjfe7VaQdYKYSenoopVFN3sZgBcfHJK-XERnkATWKJPm5ZU Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: d481226324c843ce91b1eae9cce3a87e Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesGetTestJSON-1126299613 Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 17:58:15.525569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d481226324c843ce91b1eae9cce3a87e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/d481226324c843ce91b1eae9cce3a87e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/d481226324c843ce91b1eae9cce3a87e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_d481226324c843ce91b1eae9cce3a87e", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesGetTestJSON-1126299613 Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: d481226324c843ce91b1eae9cce3a87e Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesGetTestJSON-1126299613 Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesGetTestJSON-1126299613-project Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 320bc9f0f2f241d9a6180956613f4509 Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesGetTestJSON-1126299613-project Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '7a51b4b2-412c-4294-af96-5e17c30c86f8'} Jun 14 17:58:15.526868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. (HTTP 404) (Request-ID: req-e952b45a-080d-4849-84d5-2c43ea4ab489) Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:15.527712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 17:58:15.528632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 17:58:15.529529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eecf07c4-5dd3-4e9f-95c8-bc442ec671e2 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] Returning 404 to user: Volume 7a51b4b2-412c-4294-af96-5e17c30c86f8 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-eecf07c4-5dd3-4e9f-95c8-bc442ec671e2 tempest-VolumesGetTestJSON-1126299613 tempest-VolumesGetTestJSON-1126299613-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8" status: 404 len: 109 microversion: 2.1 time: 0.102132 Jun 14 17:58:15.530520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:15 2022] GET /compute/v2.1/os-volumes/7a51b4b2-412c-4294-af96-5e17c30c86f8 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 17:58:15.778926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b68b6503-680a-4a13-a730-5fe35d391c65 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbaff19faf0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:15.845243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b68b6503-680a-4a13-a730-5fe35d391c65 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/65f13200-a04f-4e59-9c00-a21236bfb21e" status: 200 len: 350 microversion: 2.1 time: 0.070347 Jun 14 17:58:15.846007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:15 2022] GET /compute/v2.1/os-volumes/65f13200-a04f-4e59-9c00-a21236bfb21e => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:58:15.864392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-aeadb609-5915-4a24-9ac7-a1d102134ed1 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafe6dbb80>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:16.022826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-aeadb609-5915-4a24-9ac7-a1d102134ed1 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.165593 Jun 14 17:58:16.034916 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 8/14] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jun 14 17:58:15 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:16.036794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2400feae-60fb-450c-b131-26f473b28ce3 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafd66b4c0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:16.162712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7d0b899d-52ea-46a8-b189-b7aaca1be338 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:16.174326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7d0b899d-52ea-46a8-b189-b7aaca1be338 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1215 microversion: 2.1 time: 0.725595 Jun 14 17:58:16.179348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2400feae-60fb-450c-b131-26f473b28ce3 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.146595 Jun 14 17:58:16.179898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 9/15] 10.222.0.36 () {58 vars in 1148 bytes} [Tue Jun 14 17:58:16 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:16.191659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 7/16] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:15 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1215 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:16.209345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7cfd90bf-eedc-4818-b6a4-d6488ec01e64 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafd64f160>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:16.474101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7cfd90bf-eedc-4818-b6a4-d6488ec01e64 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.278417 Jun 14 17:58:16.482271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 10/17] 10.222.0.36 () {58 vars in 1133 bytes} [Tue Jun 14 17:58:16 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:16.487220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e1c1791c-e652-4399-832f-96c210fb4094 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafe798550>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:16.686061 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e1c1791c-e652-4399-832f-96c210fb4094 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.203009 Jun 14 17:58:16.687655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 8/18] 10.222.0.36 () {58 vars in 1166 bytes} [Tue Jun 14 17:58:16 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:16.699839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a893bc46-1c39-4e4c-863a-5ea5a6e0fb91 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafe6db9d0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:16.959343 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a893bc46-1c39-4e4c-863a-5ea5a6e0fb91 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.263651 Jun 14 17:58:16.959934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 11/19] 10.222.0.36 () {58 vars in 1169 bytes} [Tue Jun 14 17:58:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:16.972808 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7b016fdf-9f4f-4c3d-84b1-1a8ba53b6a38 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafe7239d0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:17.193163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:17.193298 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7b016fdf-9f4f-4c3d-84b1-1a8ba53b6a38 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.224318 Jun 14 17:58:17.195364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 9/20] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jun 14 17:58:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:17.201161 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:17.207457 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1ee8faf8-a334-4e77-8cca-a9d0afd612c2 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbafe723820>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:17.244385 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:17.249312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:17.252739 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:17.256023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:17.412825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1ee8faf8-a334-4e77-8cca-a9d0afd612c2 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.210947 Jun 14 17:58:17.413899 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 10/21] 10.222.0.36 () {58 vars in 1187 bytes} [Tue Jun 14 17:58:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:17.426146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b40dbc13-424c-4b9e-b6fc-9ac25c562193 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] Calling method '.version_select at 0x7fbaff1a0b80>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:17.722649 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:17.745805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b40dbc13-424c-4b9e-b6fc-9ac25c562193 tempest-VolumesTestJSON-1589606065 tempest-VolumesTestJSON-1589606065-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.324426 Jun 14 17:58:17.746377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1154 bytes} [Tue Jun 14 17:58:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:17.762080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3085b378-e606-46bd-867f-eb7ec0ce7a39 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1267 microversion: 2.1 time: 0.571659 Jun 14 17:58:17.763727 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:17 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1267 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:18.786644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:18.787542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:18.808754 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:18.809732 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:18.816475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:18.818451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:19.424327 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:19.498447 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-434031ab-0252-42ed-83de-090ad821aaaa tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1273 microversion: 2.1 time: 0.714722 Jun 14 17:58:19.501889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:18 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1273 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:20.519389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:20.520646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:20.530215 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:20.531519 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:20.534211 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:20.543672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:20.951217 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:20.959480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-30a58eb9-740e-43c5-84eb-ab70f211ac43 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1273 microversion: 2.1 time: 0.445187 Jun 14 17:58:20.960062 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:20 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1273 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:21.980145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:21.982076 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:22.004268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:22.004772 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:22.005578 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:22.006022 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:23.310574 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:23.325846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c8422788-efb9-4c1c-8f90-ea3422bba3f5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 1.351521 Jun 14 17:58:23.337891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 13/26] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:21 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:24.201904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:24.203625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:24.356156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:24.357388 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:24.383920 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:24.393075 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:24.395263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:24.396255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:25.209443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-47e7d846-29d3-42b7-8cf7-a8a74482e1dd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'create', calling method: .version_select at 0x7fbafd59a670>, body: {"keypair": {"name": "tempest-keypair-1631504134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWyjnWdfE3jVb6swBz+cqmhE2YBI7lHTfKPPeV38OUy44o9nwQwJRhUo47vdNw4xjDuvdBdF6UUcP8nEDw06WJAD8toc0WII3oF5CKMeUv+JHYRIrOeYXsvSOuxFHBRIQ=="}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:25.311016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-47e7d846-29d3-42b7-8cf7-a8a74482e1dd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:25.327578 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-47e7d846-29d3-42b7-8cf7-a8a74482e1dd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for user 0b64d79cbd27413cb9d6064e7b9c88e7 and project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:25.549138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-47e7d846-29d3-42b7-8cf7-a8a74482e1dd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.350643 Jun 14 17:58:25.549138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 14/27] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jun 14 17:58:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1353 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 14 17:58:25.649847 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:25.662807 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1024f8b6-e1aa-4499-9cc8-2c20b68cece0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 1.311180 Jun 14 17:58:25.671395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 14/28] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:24 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:26.691756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:26.698246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:26.730738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:26.732380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:26.734120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:26.735915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:27.217677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:27.231519 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5d0ee97e-1e66-48b3-af74-bfdbd36adf95 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.549608 Jun 14 17:58:27.255761 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 15/29] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:26 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:27.439042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=6 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:28.252699 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7df410f2-1781-425a-8e57-601b90f54572 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: .version_select at 0x7fbafe66f160>, body: {"keypair": {"name": "tempest-keypair-765269263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeXZxIOlR0Dh2I4ZM/edUYBEvSPibyi/S9RRLkMwUegCpiwj6IFLOvWGU+UDEBVZvNw/dXj8xda4kEC1h88tg7jtmGgc0aGZXjTrUX2Wz6Lzi9qcCB8qxT8UTrUZlTR5g=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:28.261622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:28.262828 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:28.279425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:28.280104 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:28.282741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:28.298387 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:28.327367 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-7df410f2-1781-425a-8e57-601b90f54572 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:28.351439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-7df410f2-1781-425a-8e57-601b90f54572 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:28.598923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7df410f2-1781-425a-8e57-601b90f54572 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.165131 Jun 14 17:58:28.603469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 15/30] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 17:58:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:29.193223 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:29.204212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-701cffc9-eeb5-42cf-9906-3e1e95308bb3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.946448 Jun 14 17:58:29.211388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 16/31] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:28 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:29.461716 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-7bd6c0dd-674f-4b16-87c5-c08e31574a65 req-c59c9417-8d00-470a-8c28-f5ab3364b6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06d0dad6-e1ee-4577-884d-358d5ddf1981", "tag": "5f12c6c5-21a6-45bb-9442-a7869565def7"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:29.536600 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7bd6c0dd-674f-4b16-87c5-c08e31574a65 req-c59c9417-8d00-470a-8c28-f5ab3364b6a9 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:29.537301 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7bd6c0dd-674f-4b16-87c5-c08e31574a65 req-c59c9417-8d00-470a-8c28-f5ab3364b6a9 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:29.650393 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-7bd6c0dd-674f-4b16-87c5-c08e31574a65 req-c59c9417-8d00-470a-8c28-f5ab3364b6a9 service nova] Creating event network-changed:5f12c6c5-21a6-45bb-9442-a7869565def7 for instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 on hv-cinder-82635 Jun 14 17:58:29.651006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7bd6c0dd-674f-4b16-87c5-c08e31574a65 req-c59c9417-8d00-470a-8c28-f5ab3364b6a9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 14 17:58:29.669176 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:29.669636 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:29.670445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:29.670885 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:29.717932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.compute.rpcapi [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 14 17:58:29.730803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] Releasing lock "compute-rpcapi-router" {{(pid=125162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 14 17:58:29.799040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-620d8737-aa7e-47bf-8afa-b6686204b44e None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.773065 Jun 14 17:58:29.800011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 16/32] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:30.225471 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:30.226262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:30.239883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:30.240637 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:30.241647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:30.260731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:31.616765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a9cc88d0-cdb9-4042-9070-0348d66e4cec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: .version_select at 0x7fbafdde71f0>, body: {"keypair": {"name": "tempest-keypair-1006205685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO/jcggMOxhm1/axgZ9dTAV7+v/dulMgFJRXQThAO93n85qSPk5aPN7vNPFuOE00bndDV5Q0Hdaoo1OmOSdQXqlssxfP2d9hApdXW2QSYxLIDBj6LsnddEWlhHvOlJsbA=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:31.675841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:31.683213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-a9cc88d0-cdb9-4042-9070-0348d66e4cec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:31.694717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-23e09bc3-4a93-4f29-a282-9a452e76bac0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 1.469785 Jun 14 17:58:31.699647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 17/33] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:30 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:31.701247 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-a9cc88d0-cdb9-4042-9070-0348d66e4cec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for user 41680577c34d4b9090270d3097a7e02c and project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:31.902804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a9cc88d0-cdb9-4042-9070-0348d66e4cec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.716706 Jun 14 17:58:31.902804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 17/34] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 17:58:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:58:32.512355 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-da5f4afc-8624-48e3-8c6d-f79841680fd5 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Action: 'create', calling method: .version_select at 0x7fbafd553ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1026914682", "metadata": {"Type": "work"}}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-da5f4afc-8624-48e3-8c6d-f79841680fd5 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Request method failure captured: Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 122 Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxHuVyHrITBruXpBfMitv3K-CdaZp-vEpMgh-NtgC9DJy2SLhpVxYyjfxACCfVrYeKCUTyVCYot4zO5VlzSfk-94M09Yf-C4Y_xiqME6pJrpvbywWDbm0cMro9ZVF0FveyooowFarT8N5-QSdMpnh27_hRhXRNcnq0SvYPJ8rWSSbw Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 17:58:32.547870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_124e06b7e0224b6faaad98d11982e713", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 62057896b631456eb8514c288e5a4273 Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1026914682", "metadata": {"Type": "work"}}} Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: Jun 14 17:58:32.549295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1026914682', 'metadata': {'Type': 'work'}}}} Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise error Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi '#$%' Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:32.550126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 17:58:32.551537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 17:58:32.552674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 14 17:58:32.552674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.553255 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-da5f4afc-8624-48e3-8c6d-f79841680fd5 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:32.554047 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-da5f4afc-8624-48e3-8c6d-f79841680fd5 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.659012 Jun 14 17:58:32.559062 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 18/35] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 14 17:58:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 661 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 17:58:32.565980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-dad5db05-b1dc-4ec7-874c-306642ea3727 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Action: 'create', calling method: .version_select at 0x7fbafde13160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-151162869", "metadata": {"Type": "work"}}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-dad5db05-b1dc-4ec7-874c-306642ea3727 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Request method failure captured: Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 119 Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxHuVyHrITBruXpBfMitv3K-CdaZp-vEpMgh-NtgC9DJy2SLhpVxYyjfxACCfVrYeKCUTyVCYot4zO5VlzSfk-94M09Yf-C4Y_xiqME6pJrpvbywWDbm0cMro9ZVF0FveyooowFarT8N5-QSdMpnh27_hRhXRNcnq0SvYPJ8rWSSbw Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 17:58:32.571965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_124e06b7e0224b6faaad98d11982e713", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 62057896b631456eb8514c288e5a4273 Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-151162869", "metadata": {"Type": "work"}}} Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: Jun 14 17:58:32.573418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-151162869', 'metadata': {'Type': 'work'}}}} Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise error Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi '0' Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:32.579277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 17:58:32.580554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 17:58:32.581612 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 14 17:58:32.581612 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.581612 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-dad5db05-b1dc-4ec7-874c-306642ea3727 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:32.581612 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-dad5db05-b1dc-4ec7-874c-306642ea3727 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013033 Jun 14 17:58:32.589725 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cc19ee51-84dc-4fc9-8c36-c94a15983b67 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Action: 'create', calling method: .version_select at 0x7fbafd53aa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1045191365", "metadata": {"Type": "work"}}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:32.608877 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 18/36] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 14 17:58:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cc19ee51-84dc-4fc9-8c36-c94a15983b67 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Request method failure captured: Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 119 Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxHuVyHrITBruXpBfMitv3K-CdaZp-vEpMgh-NtgC9DJy2SLhpVxYyjfxACCfVrYeKCUTyVCYot4zO5VlzSfk-94M09Yf-C4Y_xiqME6pJrpvbywWDbm0cMro9ZVF0FveyooowFarT8N5-QSdMpnh27_hRhXRNcnq0SvYPJ8rWSSbw Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 17:58:32.620101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_124e06b7e0224b6faaad98d11982e713", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 62057896b631456eb8514c288e5a4273 Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1045191365", "metadata": {"Type": "work"}}} Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: Jun 14 17:58:32.621454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1045191365', 'metadata': {'Type': 'work'}}}} Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise error Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi '' Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:32.622213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 14 17:58:32.623501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 14 17:58:32.624953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 14 17:58:32.624953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.624953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cc19ee51-84dc-4fc9-8c36-c94a15983b67 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:32.628950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cc19ee51-84dc-4fc9-8c36-c94a15983b67 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.048786 Jun 14 17:58:32.642280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1155 bytes} [Tue Jun 14 17:58:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 14 17:58:32.661240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-04a9dda5-d982-4e28-8711-5ccfb78e5709 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Calling method '.version_select at 0x7fbafde138b0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:32.720078 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:32.721924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:32.755448 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:32.755914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:32.763714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:32.764218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:32.795637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-04a9dda5-d982-4e28-8711-5ccfb78e5709 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] HTTP exception thrown: Volume tempest-invalid-587654331 could not be found. Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-04a9dda5-d982-4e28-8711-5ccfb78e5709 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Request method failure captured: Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-587654331 HTTP/1.1 Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxHuVyHrITBruXpBfMitv3K-CdaZp-vEpMgh-NtgC9DJy2SLhpVxYyjfxACCfVrYeKCUTyVCYot4zO5VlzSfk-94M09Yf-C4Y_xiqME6pJrpvbywWDbm0cMro9ZVF0FveyooowFarT8N5-QSdMpnh27_hRhXRNcnq0SvYPJ8rWSSbw Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 17:58:32.803989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_124e06b7e0224b6faaad98d11982e713", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 62057896b631456eb8514c288e5a4273 Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Volume tempest-invalid-587654331 could not be found. Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'tempest-invalid-587654331'} Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:32.805679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-587654331 could not be found. (HTTP 404) (Request-ID: req-f75dfea0-b16b-42d1-8987-80e55b607a36) Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.806519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 17:58:32.807469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-587654331 could not be found. Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:58:32.808352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-587654331 could not be found. Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-587654331 could not be found. Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-04a9dda5-d982-4e28-8711-5ccfb78e5709 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Returning 404 to user: Volume tempest-invalid-587654331 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-04a9dda5-d982-4e28-8711-5ccfb78e5709 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-587654331" status: 404 len: 98 microversion: 2.1 time: 0.157703 Jun 14 17:58:32.809396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 19/38] 10.222.0.36 () {58 vars in 1214 bytes} [Tue Jun 14 17:58:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-587654331 => generated 98 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 14 17:58:32.856608 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a8871ff4-1c81-4a04-8666-795b5f63d0fd tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.041651 Jun 14 17:58:32.857329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 20/39] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jun 14 17:58:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 14 17:58:32.918258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bc56d272-6b76-45de-8709-4ac414731403 tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.046942 Jun 14 17:58:32.925667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 21/40] 10.222.0.36 () {58 vars in 1136 bytes} [Tue Jun 14 17:58:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 14 17:58:32.942176 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0b712b7e-655a-4908-ad8e-5ca381faed8b tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Calling method '.version_select at 0x7fbafde13310>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:33.044864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-0b712b7e-655a-4908-ad8e-5ca381faed8b tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] HTTP exception thrown: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0b712b7e-655a-4908-ad8e-5ca381faed8b tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Request method failure captured: Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/os-volumes/c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 HTTP/1.1 Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxHuVyHrITBruXpBfMitv3K-CdaZp-vEpMgh-NtgC9DJy2SLhpVxYyjfxACCfVrYeKCUTyVCYot4zO5VlzSfk-94M09Yf-C4Y_xiqME6pJrpvbywWDbm0cMro9ZVF0FveyooowFarT8N5-QSdMpnh27_hRhXRNcnq0SvYPJ8rWSSbw Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 17:58:33.047648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_124e06b7e0224b6faaad98d11982e713", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 62057896b631456eb8514c288e5a4273 Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81'} Jun 14 17:58:33.048976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. (HTTP 404) (Request-ID: req-1e542e0d-27e2-45aa-aa19-e2197ebbd83d) Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:33.049649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 17:58:33.050561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 17:58:33.051599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0b712b7e-655a-4908-ad8e-5ca381faed8b tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Returning 404 to user: Volume c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0b712b7e-655a-4908-ad8e-5ca381faed8b tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81" status: 404 len: 109 microversion: 2.1 time: 0.119088 Jun 14 17:58:33.052520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 17:58:32 2022] DELETE /compute/v2.1/os-volumes/c09ec0da-5d58-4929-a4e8-a8cd7c3f9c81 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 17:58:33.080764 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-12f2096b-2c34-47e7-a606-182be7ee5ade tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Calling method '.version_select at 0x7fbafcd9d160>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:33.225365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-12f2096b-2c34-47e7-a606-182be7ee5ade tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] HTTP exception thrown: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-12f2096b-2c34-47e7-a606-182be7ee5ade tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Request method failure captured: Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/os-volumes/d19108cb-5c31-43f6-b76b-61bf78179c5c HTTP/1.1 Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxHuVyHrITBruXpBfMitv3K-CdaZp-vEpMgh-NtgC9DJy2SLhpVxYyjfxACCfVrYeKCUTyVCYot4zO5VlzSfk-94M09Yf-C4Y_xiqME6pJrpvbywWDbm0cMro9ZVF0FveyooowFarT8N5-QSdMpnh27_hRhXRNcnq0SvYPJ8rWSSbw Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 17:58:33.227759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/124e06b7e0224b6faaad98d11982e713"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_124e06b7e0224b6faaad98d11982e713", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 124e06b7e0224b6faaad98d11982e713 Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesNegativeTest-15089690 Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 62057896b631456eb8514c288e5a4273 Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesNegativeTest-15089690-project Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'd19108cb-5c31-43f6-b76b-61bf78179c5c'} Jun 14 17:58:33.228860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. (HTTP 404) (Request-ID: req-2fc04fc0-5f88-4b15-b203-6e4348dd3572) Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:33.229546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 17:58:33.241599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 17:58:33.242550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-12f2096b-2c34-47e7-a606-182be7ee5ade tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] Returning 404 to user: Volume d19108cb-5c31-43f6-b76b-61bf78179c5c could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-12f2096b-2c34-47e7-a606-182be7ee5ade tempest-VolumesNegativeTest-15089690 tempest-VolumesNegativeTest-15089690-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d19108cb-5c31-43f6-b76b-61bf78179c5c" status: 404 len: 109 microversion: 2.1 time: 0.173368 Jun 14 17:58:33.243508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 17:58:33 2022] GET /compute/v2.1/os-volumes/d19108cb-5c31-43f6-b76b-61bf78179c5c => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 17:58:33.643815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:33.657967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bf24136f-41a9-42a5-9f01-0090724d9e0a tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.943663 Jun 14 17:58:33.659192 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 20/43] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:32 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:34.193025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1496670959", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e011f604-6fca-46ed-99f7-5d3a1263dd79"}], "security_groups": [{"name": "tempest-securitygroup--799063204"}], "key_name": "tempest-keypair-1631504134", "user_data": "}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:34.679976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:34.683324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:34.685068 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] validate_networks() for [('e011f604-6fca-46ed-99f7-5d3a1263dd79', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:58:34.731513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:34.735502 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:34.738533 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:34.739915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:35.362713 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:35.451491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:35.463635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c5899297-2ebe-41f3-81ca-6c6993a8a86e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.791607 Jun 14 17:58:35.464665 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 21/44] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:34 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:36.483139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:36.483917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:36.500197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:36.500912 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:36.506492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:36.506492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:37.028811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:37.044942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9d725a34-539c-4fa7-8125-74e4e8d0b2e6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.565517 Jun 14 17:58:37.047262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:36 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:37.057463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-449303773", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0964eb9b-e0dc-493c-8b01-2ac272fdf32e"}], "security_groups": [{"name": "tempest-securitygroup--562122832"}], "key_name": "tempest-keypair-765269263", "user_data": "}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:37.240150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:58:37.243883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:58:37.244346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:58:37.244767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:58:37.245230 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:58:37.274876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:37.285215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:37.291104 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:37.294179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:37.326313 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:37.332605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for user 0b64d79cbd27413cb9d6064e7b9c88e7 and project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:37.333153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] validate_networks() for [('0964eb9b-e0dc-493c-8b01-2ac272fdf32e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:58:37.372210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:58:37.392513 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:58:37.674353 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6861fc92-f136-4e5e-9c85-62e93c040133 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.486278 Jun 14 17:58:37.677839 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 24/46] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jun 14 17:58:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 3493 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 14 17:58:37.692510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b6989b15-5920-4824-9bda-1e8b852ba02d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:37.693856 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b6989b15-5920-4824-9bda-1e8b852ba02d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:37.946352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b6989b15-5920-4824-9bda-1e8b852ba02d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:37.971904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b6989b15-5920-4824-9bda-1e8b852ba02d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:37.978109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b6989b15-5920-4824-9bda-1e8b852ba02d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:37.987604 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b6989b15-5920-4824-9bda-1e8b852ba02d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1282 microversion: 2.20 time: 0.297204 Jun 14 17:58:37.990132 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 25/47] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:37 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1282 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 17:58:38.067588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:38.073086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:38.086695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:38.089892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:38.092048 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:38.092597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:38.423770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:38.447597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0e12c4c9-620e-47ec-83e3-de8d249763a6 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.386057 Jun 14 17:58:38.449130 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 26/48] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:38 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:38.745467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:58:38.750365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:58:38.750365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:58:38.750365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:58:38.750365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:58:38.760022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:38.760595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:38.761652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:38.762268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:38.808442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:38.817814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:38.850767 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:58:38.872787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:58:39.012751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e8926957-de6c-4f87-8b0c-28051751fa77 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:39.012943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e8926957-de6c-4f87-8b0c-28051751fa77 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:39.015083 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=5 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:39.126397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c9437348-32e1-4120-84c6-432c43a4de87 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.067658 Jun 14 17:58:39.126759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 23/49] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 17:58:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 17:58:39.155506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-22b2176b-bb6e-4e89-a2e2-0338f479b594 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:39.155506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-22b2176b-bb6e-4e89-a2e2-0338f479b594 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:39.172752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e8926957-de6c-4f87-8b0c-28051751fa77 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:39.192154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e8926957-de6c-4f87-8b0c-28051751fa77 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:39.196769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e8926957-de6c-4f87-8b0c-28051751fa77 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:39.200899 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e8926957-de6c-4f87-8b0c-28051751fa77 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1282 microversion: 2.20 time: 0.194433 Jun 14 17:58:39.205792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 27/50] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:39 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:39.342703 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-22b2176b-bb6e-4e89-a2e2-0338f479b594 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:39.364478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-22b2176b-bb6e-4e89-a2e2-0338f479b594 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1240 microversion: 2.1 time: 0.228765 Jun 14 17:58:39.375833 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 24/51] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:39 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1240 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:39.466420 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:39.467016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:39.473802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:39.474278 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:39.475058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:39.475551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:39.681506 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:39.732607 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1283e2a5-bd9b-4168-a40a-0b77b580b9af tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.257111 Jun 14 17:58:39.734007 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:39 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:39.841641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-244666844", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e0e0d91-14bd-4c5d-9db2-a2d04d1c9f93"}], "security_groups": [{"name": "tempest-securitygroup--356083506"}], "key_name": "tempest-keypair-1006205685", "user_data": "}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:39.955777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] validate_networks() for [('3e0e0d91-14bd-4c5d-9db2-a2d04d1c9f93', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:58:40.224308 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5a8fcd9d-ea2c-45fb-808b-6244b79aafe5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:40.224924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5a8fcd9d-ea2c-45fb-808b-6244b79aafe5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:40.285462 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5a8fcd9d-ea2c-45fb-808b-6244b79aafe5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:40.294607 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5a8fcd9d-ea2c-45fb-808b-6244b79aafe5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:40.296155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5a8fcd9d-ea2c-45fb-808b-6244b79aafe5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:40.298554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5a8fcd9d-ea2c-45fb-808b-6244b79aafe5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1282 microversion: 2.20 time: 0.078660 Jun 14 17:58:40.299122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 29/53] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:40 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 17:58:40.379582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:58:40.380330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:58:40.380804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:58:40.381221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:58:40.382342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:58:40.383576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5c1dfbac-5cfa-4dde-992e-b866919c3734 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:40.384376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5c1dfbac-5cfa-4dde-992e-b866919c3734 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:40.384492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:40.403944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:40.404406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:40.405210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:40.405732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:40.411165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=53 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:40.443783 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:58:40.451467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for user 41680577c34d4b9090270d3097a7e02c and project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:58:40.455929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5c1dfbac-5cfa-4dde-992e-b866919c3734 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:40.463990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:58:40.473042 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:58:40.473255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5c1dfbac-5cfa-4dde-992e-b866919c3734 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1240 microversion: 2.1 time: 0.088281 Jun 14 17:58:40.473255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 30/54] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:40 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:40.753532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:40.754326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:40.761337 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:40.762069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:40.763110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:40.763590 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:40.911271 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:40.943739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9ab81ac9-ae23-4285-8346-f884d991dc47 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.195184 Jun 14 17:58:40.955865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 31/55] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:40 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:40.957833 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6825fbf4-134f-460e-92c3-2b706be2fdc1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.120411 Jun 14 17:58:40.963254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 25/56] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 17:58:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 17:58:40.973601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c367bf5c-de32-49d9-952c-357e7f225b67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:40.974273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c367bf5c-de32-49d9-952c-357e7f225b67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:41.060187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c367bf5c-de32-49d9-952c-357e7f225b67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:41.073342 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c367bf5c-de32-49d9-952c-357e7f225b67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1237 microversion: 2.1 time: 0.107568 Jun 14 17:58:41.074596 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 32/57] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:40 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:41.319132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:41.319132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:41.343953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:41.346573 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:41.347865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:41.355324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:41.432898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:41.442005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:41.445994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:41.447849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-42272600-b33b-4e90-91a1-1ee82540fb7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1278 microversion: 2.20 time: 0.135052 Jun 14 17:58:41.449027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 26/58] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:41 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:41.487523 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:41.488143 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:41.506368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:41.507529 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:41.509224 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:41.510131 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:41.621677 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:41.636644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7272c9b0-c074-4399-bb3d-1d5c51d4fbd1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1244 microversion: 2.1 time: 0.154290 Jun 14 17:58:41.647962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 33/59] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:41 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1244 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:41.966554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:41.966554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:41.973916 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:41.974381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:41.978323 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:41.978323 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:42.091984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-754a1eb4-181a-4a7d-b63a-3f3d811f556f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:42.092957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-754a1eb4-181a-4a7d-b63a-3f3d811f556f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:42.169992 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-754a1eb4-181a-4a7d-b63a-3f3d811f556f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:42.177546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-754a1eb4-181a-4a7d-b63a-3f3d811f556f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1237 microversion: 2.1 time: 0.090605 Jun 14 17:58:42.199724 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 34/60] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:42 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1237 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:42.310959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:42.322601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ee0f1149-610c-43ee-8581-6893ab9c38b2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.359639 Jun 14 17:58:42.323345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 27/61] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:41 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:42.470863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:42.471805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:42.479656 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:42.480427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:42.481586 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:42.482077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:42.595979 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:42.630492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:42.637483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:42.641582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0480e08a-b859-4396-97ce-7ce447630d0e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1352 microversion: 2.20 time: 0.175014 Jun 14 17:58:42.643557 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 35/62] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:42 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1352 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:42.656868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:42.657853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:42.665086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:42.665781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:42.666953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:42.667446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:42.774651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:42.785999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c653cd68-6c6b-44dd-8fda-23263af8fb7f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1292 microversion: 2.1 time: 0.134246 Jun 14 17:58:42.798163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 28/63] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:42 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1292 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:43.204725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:43.205389 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:43.211588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.212037 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.212796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.213224 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.343283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:43.344516 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:43.361912 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.364052 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.367082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.367082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.399129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:43.412646 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b2f85f17-202b-406b-b828-990367cc6707 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1241 microversion: 2.1 time: 0.211031 Jun 14 17:58:43.413137 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 36/64] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:43 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1241 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:43.666108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:43.667038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:43.693573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.694375 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.695206 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.697254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.752559 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:43.769553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4e42e278-ed14-497f-8144-0abaff5df8d8 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.430735 Jun 14 17:58:43.770505 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 29/65] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:43 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:43.804012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:43.807875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:43.827867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.828735 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.833014 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:43.833909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:43.963423 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:43.976155 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5c4d271a-00d1-4be7-ace7-26d0537531b4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1310 microversion: 2.1 time: 0.176109 Jun 14 17:58:43.976920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 30/66] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:43 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1310 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:44.320243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:44.330993 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:44.333201 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:44.334788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4c57d50a-c2a5-43ca-82c1-606b26c243db tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.675834 Jun 14 17:58:44.335749 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 37/67] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:43 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:44.431949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:44.432574 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:44.441086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:44.441771 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:44.443020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:44.443667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:44.563283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:44.572593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3d57833c-9162-4bc6-a589-7ff71942be03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1297 microversion: 2.1 time: 0.145910 Jun 14 17:58:44.573831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 31/68] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:44 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:44.787937 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:44.788564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:44.795863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:44.796675 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:44.797707 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:44.798660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:44.996445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:44.997034 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:45.004809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.014504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.014504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.014504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.181637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:45.193949 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2e7dd6e2-b474-4a67-a5d4-59660fcb018e tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.407359 Jun 14 17:58:45.194594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 38/69] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:44 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:45.228511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:45.245374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fb286187-cf56-4dd3-b25d-80235189cf1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1298 microversion: 2.1 time: 0.252291 Jun 14 17:58:45.246543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 32/70] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:44 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1298 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:45.355154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:45.355793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:45.364612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.365568 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.366831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.367518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.471992 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-3ca7dfaf-e372-4fd6-a24d-8c32da2731da req-bc19693f-0d0f-4cdf-bb84-baa114b66f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d0dad6-e1ee-4577-884d-358d5ddf1981", "name": "network-vif-plugged", "status": "completed", "tag": "5f12c6c5-21a6-45bb-9442-a7869565def7"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:45.481233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-3ca7dfaf-e372-4fd6-a24d-8c32da2731da req-bc19693f-0d0f-4cdf-bb84-baa114b66f5e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.481670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-3ca7dfaf-e372-4fd6-a24d-8c32da2731da req-bc19693f-0d0f-4cdf-bb84-baa114b66f5e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.494108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-3ca7dfaf-e372-4fd6-a24d-8c32da2731da req-bc19693f-0d0f-4cdf-bb84-baa114b66f5e service nova] Creating event network-vif-plugged:5f12c6c5-21a6-45bb-9442-a7869565def7 for instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 on hv-cinder-82635 Jun 14 17:58:45.501280 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-3ca7dfaf-e372-4fd6-a24d-8c32da2731da req-bc19693f-0d0f-4cdf-bb84-baa114b66f5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156566 Jun 14 17:58:45.501989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 39/71] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:45.592190 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:45.592892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:45.607785 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.608486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.610252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.611045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.698400 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:45.777970 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:45.784846 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:45.788687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:45.792394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a5c51b82-7a82-41bc-a1e6-f25839a1c0bb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.442143 Jun 14 17:58:45.793620 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 33/72] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:45 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:45.801451 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-9c918479-c9b6-4c30-a61a-c89c9e284fdc req-5debfc00-72d6-490f-8a8f-c87c422793e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:45.812223 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4c463db4-78fe-4d56-b36d-803cbfc2cf28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1295 microversion: 2.1 time: 0.224314 Jun 14 17:58:45.813942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 40/73] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:45 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1295 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:45.832103 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-9c918479-c9b6-4c30-a61a-c89c9e284fdc req-5debfc00-72d6-490f-8a8f-c87c422793e0 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.832553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-9c918479-c9b6-4c30-a61a-c89c9e284fdc req-5debfc00-72d6-490f-8a8f-c87c422793e0 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.854297 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-9c918479-c9b6-4c30-a61a-c89c9e284fdc req-5debfc00-72d6-490f-8a8f-c87c422793e0 service nova] Creating event network-changed:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 17:58:45.854787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-9c918479-c9b6-4c30-a61a-c89c9e284fdc req-5debfc00-72d6-490f-8a8f-c87c422793e0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125161) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 14 17:58:45.857275 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.858310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.860831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:45.861680 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:45.873735 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.compute.rpcapi [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 14 17:58:45.875693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] Releasing lock "compute-rpcapi-router" {{(pid=125161) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 14 17:58:45.896823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5002c3df-ea75-4874-a78c-5030a09be258 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099767 Jun 14 17:58:45.934472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 34/74] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:46.217322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:46.220464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:46.233715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.235869 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.237219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.238972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.269969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:46.271520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:46.286484 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.286851 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.287666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.288268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.561274 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:46.576609 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4fc5c5cd-d0d5-4c6d-986d-0d3dbe28f530 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.367333 Jun 14 17:58:46.587268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 41/75] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:46 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:46.668982 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:46.675541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4d604b16-fd4c-4578-8fb5-fc69250e4118 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.416305 Jun 14 17:58:46.676170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 35/76] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:46 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:46.820576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:46.821107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:46.829956 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.830412 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.831265 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.831739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.837397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:46.838702 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:46.845699 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.846148 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.847087 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:46.847558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:46.945562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:46.954139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4842baff-419b-492c-89b8-ec6dc4a4afb9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1295 microversion: 2.1 time: 0.120535 Jun 14 17:58:46.954932 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 36/77] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:46 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1295 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:46.985675 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:46.994836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:46.996378 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:46.997487 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bc016ea5-af90-40cc-94a7-151e6fc026c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.181637 Jun 14 17:58:46.998045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 42/78] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:46 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:47.595829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:47.597572 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:47.610023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:47.611612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:47.613685 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:47.633235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:47.693619 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:47.694139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:47.696202 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=4 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:47.704268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:47.704268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:47.705313 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:47.706489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:47.978550 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:47.996376 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-67e1a477-02b2-4877-8683-5706b0766959 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.406254 Jun 14 17:58:47.997554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 37/79] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:47 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:48.010675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:48.011419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:48.019711 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:48.020273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:48.021288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:48.022951 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:48.204087 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:48.214403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-01ac3772-d750-43fd-8231-de0267682a5b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.215482 Jun 14 17:58:48.215429 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 38/80] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:47 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:48.220540 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:48.221758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:48.229342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:48.230075 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:48.231262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:48.233486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:48.336756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:48.348109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5c70dc6c-2b5a-4e3f-8339-a5b55c5e7a1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.657600 Jun 14 17:58:48.349110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 43/81] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:47 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:48.518461 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:48.530730 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:48.532942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:48.534086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-614175a9-2d30-4c0e-b9e5-4bbd8586113b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.317604 Jun 14 17:58:48.536821 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 39/82] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:48 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:48.794792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-62f14083-2f4b-4d95-9a3e-c1aef63a8493 req-0b58f022-94c0-4c19-9534-44aa1def59ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97278dbc-a791-43fb-b077-cd4f0a0bebf7", "tag": "308799a5-8ca4-4e1c-ae5f-b7ca777bdb74"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:48.804226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-62f14083-2f4b-4d95-9a3e-c1aef63a8493 req-0b58f022-94c0-4c19-9534-44aa1def59ef service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:48.804681 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-62f14083-2f4b-4d95-9a3e-c1aef63a8493 req-0b58f022-94c0-4c19-9534-44aa1def59ef service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:48.808753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=99 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:48.816386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-62f14083-2f4b-4d95-9a3e-c1aef63a8493 req-0b58f022-94c0-4c19-9534-44aa1def59ef service nova] Creating event network-changed:308799a5-8ca4-4e1c-ae5f-b7ca777bdb74 for instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 on hv-cinder-82635 Jun 14 17:58:48.821445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-62f14083-2f4b-4d95-9a3e-c1aef63a8493 req-0b58f022-94c0-4c19-9534-44aa1def59ef service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154514 Jun 14 17:58:48.822322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 44/83] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:49.014549 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:49.016328 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:49.022845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.023332 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.024304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.024756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.191613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:49.199569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-10ea9d48-b3a5-40a2-896d-9b3a0c811c00 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.189351 Jun 14 17:58:49.200326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 40/84] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:49 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:49.235804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:49.237077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:49.244893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.246598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.246598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.247543 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.366288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:49.367790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:49.391804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.394152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.398575 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.400922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.606743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:49.616061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-583f562d-e0dd-4376-8532-81a701d47f98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.254238 Jun 14 17:58:49.628167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 41/85] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:49 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:49.628167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:49.628167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:49.634375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.634950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.635875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:49.636380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:49.774405 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:49.791216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e8a0bae5-e8f6-4930-9b95-cd221b44dbbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.561058 Jun 14 17:58:49.799668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 45/86] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:49 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:49.923337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:49.925717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:49.932180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:49.933688 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:49.934793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0e21e418-3646-4525-9b64-58d8c9baaf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.316668 Jun 14 17:58:49.946401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 42/87] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:49 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:50.217382 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:50.218317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:50.225205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.226016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.227194 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.228045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.636347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:50.636971 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:50.644553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=14 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:50.655078 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.656501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.656501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.656798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.834382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:50.840776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:50.845377 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-35d9325e-2e30-4a70-bd6f-e6de50af2b32 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.213757 Jun 14 17:58:50.846189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 43/88] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:50 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:50.852199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:50.853057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:50.862579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.863409 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.876820 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b1627ff2-e486-4c60-8517-9f1a71bbd515 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1315 microversion: 2.1 time: 0.650236 Jun 14 17:58:50.877081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.877081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.877250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 46/89] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:50 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:50.877250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-9d4c500a-3ab5-4719-adcb-1e69311860bf req-302dc13a-a2fa-4fdb-b7c6-b99221c5ec7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2412cb1-a36e-4e84-92d7-ca0c179b6993", "tag": "c319c807-d07b-43be-a8ee-999e7a34ee23"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:50.897448 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-9d4c500a-3ab5-4719-adcb-1e69311860bf req-302dc13a-a2fa-4fdb-b7c6-b99221c5ec7d service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.898038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-9d4c500a-3ab5-4719-adcb-1e69311860bf req-302dc13a-a2fa-4fdb-b7c6-b99221c5ec7d service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.916293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-9d4c500a-3ab5-4719-adcb-1e69311860bf req-302dc13a-a2fa-4fdb-b7c6-b99221c5ec7d service nova] Creating event network-changed:c319c807-d07b-43be-a8ee-999e7a34ee23 for instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 on hv-cinder-82635 Jun 14 17:58:50.934864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-9d4c500a-3ab5-4719-adcb-1e69311860bf req-302dc13a-a2fa-4fdb-b7c6-b99221c5ec7d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067602 Jun 14 17:58:50.934864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 47/90] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:50.953855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:50.954508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:50.960826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.961277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:50.962056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:50.964361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:51.090035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:51.099044 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9cbf3c3d-6191-4b34-83b8-cfc98caa11e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.251321 Jun 14 17:58:51.100892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 44/91] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:50 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:51.169739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:51.178599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:51.180157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:51.181541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5909955f-9c35-4844-b67a-6315fc39b51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.232121 Jun 14 17:58:51.183606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 48/92] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:50 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:51.864867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:51.865569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:51.872141 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:51.872805 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:51.873551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:51.874593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:51.887908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:51.904179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:51.929244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:51.929969 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:51.930780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:51.931222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:52.037241 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:52.045824 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-69026eeb-bfe3-41af-9a9e-a6064dabc243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.186561 Jun 14 17:58:52.046403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 45/93] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:51 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:52.118248 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:52.118750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:52.126242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:52.127747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:52.131581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:52.131581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:52.178746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=26 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:52.275384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:52.288988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1d244328-ed71-4cc6-aafc-42155cd57ea2 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1502 microversion: 2.1 time: 0.406270 Jun 14 17:58:52.289865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 49/94] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:51 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:52.294893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:52.295942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:52.303827 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:52.305358 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:52.306449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:52.307030 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:52.333412 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:52.355608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4689f4a8-e18a-4959-bd1c-214d2304ae89 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.228705 Jun 14 17:58:52.355608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 46/95] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:52 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:52.529190 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:52.538364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:52.542458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:52.548139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6c47d1c2-983c-4842-927f-08ce718d6a87 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.252603 Jun 14 17:58:52.548139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 50/96] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:52 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:52.966604 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-035e6f9b-3d8e-4b7f-95ae-7292729f0bbb req-a3d8eaee-2ef5-4ce5-a6e1-abf411163321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "name": "network-vif-plugged", "status": "completed", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:52.975188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-035e6f9b-3d8e-4b7f-95ae-7292729f0bbb req-a3d8eaee-2ef5-4ce5-a6e1-abf411163321 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:52.975802 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-035e6f9b-3d8e-4b7f-95ae-7292729f0bbb req-a3d8eaee-2ef5-4ce5-a6e1-abf411163321 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:52.986620 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-035e6f9b-3d8e-4b7f-95ae-7292729f0bbb req-a3d8eaee-2ef5-4ce5-a6e1-abf411163321 service nova] Creating event network-vif-plugged:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 17:58:52.991497 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-035e6f9b-3d8e-4b7f-95ae-7292729f0bbb req-a3d8eaee-2ef5-4ce5-a6e1-abf411163321 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028553 Jun 14 17:58:52.993901 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 47/97] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:53.079336 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:53.080002 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:53.099969 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:53.100787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:53.101741 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:53.105853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:53.373264 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:53.373969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:53.389758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:53.390230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:53.393064 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:53.393515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:53.619015 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:53.637919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-97ba67b8-b92e-42b7-ba4e-215ff1fc957d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.269454 Jun 14 17:58:53.649822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 48/98] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:53 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:53.654662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:53.655263 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:53.667382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:53.672472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:53.672472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:53.672472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:53.762108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:53.787951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d59e4a18-8949-4833-8a75-9aac48b69a06 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.724708 Jun 14 17:58:53.788951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:53 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:53.878774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:53.893037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:53.896078 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:53.898446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1f01a6f8-06c1-475d-bf13-536ec6ced516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.247389 Jun 14 17:58:53.899682 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 49/100] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:53 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:54.587559 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af9ea9e7-7479-447e-b4e4-ec62090ca8d6"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:54.588716 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:54.595250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:54.595736 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:54.596711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:54.597354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:54.660803 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:54.660803 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:54.672340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:54.673002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:54.678956 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:54.679437 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:54.865130 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:54.873284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0385a6df-0869-4c58-9a1f-6f966eefcebf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.219827 Jun 14 17:58:54.873862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 50/101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:54 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:54.878539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:54.887524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:54.887524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:54.887524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:54.887524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:54.888042 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:55.045379 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:55.053757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-946ade03-da54-4270-838d-afc3d21c91d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.178666 Jun 14 17:58:55.065914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 51/102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:54 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:55.065914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:55.065914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:55.067942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:55.068621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:55.069407 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:55.069984 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:55.217914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:55.234127 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:55.237153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:55.238604 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9998d9dd-8c61-4cbf-a4ce-6ed03ee572bc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1407 microversion: 2.20 time: 0.181995 Jun 14 17:58:55.239498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 52/103] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:55 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:58:55.891696 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:55.893119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:55.895453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:58:55.902582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:55.903021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:55.904012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:55.904608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.056913 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:56.066856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-22c75a8a-a2a1-4365-b8e9-5c8d4ca22b16 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.178167 Jun 14 17:58:56.068870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 53/104] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:55 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:56.074125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:56.074898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:56.081860 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:56.082324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.083103 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:56.083629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.230520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:56.238282 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0fb89f34-cf0a-467a-bfa4-528354cd358f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.167905 Jun 14 17:58:56.239074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 54/105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:56 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:56.262328 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:56.262328 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:56.264045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:56.264494 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.265289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:56.265707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.365146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-91a7ef97-2b49-422b-9179-3cdfe2aa9576 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "POST /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.768897 Jun 14 17:58:56.365146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 52/106] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 17:58:54 2022] POST /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981/os-volume_attachments => generated 194 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:56.430950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:56.441335 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:56.442960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:56.444171 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-64572088-b629-4006-a64f-8311a62f9fdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1599 microversion: 2.20 time: 0.191110 Jun 14 17:58:56.444906 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 55/107] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:58:56 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1599 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 17:58:56.464230 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:56.464815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:56.472847 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:56.473305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.474095 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:56.474540 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:56.568467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c4ff9d30-3ad9-4a38-b838-02aa1b97d164 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108715 Jun 14 17:58:56.569429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 53/108] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jun 14 17:58:56 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:58:57.085341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:57.085954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:57.092053 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:57.092512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:57.093721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:57.094760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:57.236471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-caa420d2-8ac0-4e9d-8461-6a46bea0683a req-1afc26ba-6b6f-400b-ba21-040dda43d5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97278dbc-a791-43fb-b077-cd4f0a0bebf7", "name": "network-vif-plugged", "status": "completed", "tag": "308799a5-8ca4-4e1c-ae5f-b7ca777bdb74"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:57.258794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-caa420d2-8ac0-4e9d-8461-6a46bea0683a req-1afc26ba-6b6f-400b-ba21-040dda43d5d0 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:57.259403 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-caa420d2-8ac0-4e9d-8461-6a46bea0683a req-1afc26ba-6b6f-400b-ba21-040dda43d5d0 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:57.272118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-caa420d2-8ac0-4e9d-8461-6a46bea0683a req-1afc26ba-6b6f-400b-ba21-040dda43d5d0 service nova] Creating event network-vif-plugged:308799a5-8ca4-4e1c-ae5f-b7ca777bdb74 for instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 on hv-cinder-82635 Jun 14 17:58:57.277913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-caa420d2-8ac0-4e9d-8461-6a46bea0683a req-1afc26ba-6b6f-400b-ba21-040dda43d5d0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048242 Jun 14 17:58:57.278804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 54/109] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:58:57.284995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:57.285805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:57.293008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:57.293569 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:57.294441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:57.295150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:57.552446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:57.561022 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ce57929c-7016-4167-9406-c0ccec5c44c1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.280877 Jun 14 17:58:57.561601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:57 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:57.616262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:57.624758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3ea695b4-47db-4c09-a52c-1789d33d2514 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.543253 Jun 14 17:58:57.625432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:57 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:58.494585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-62d31f58-4a43-4775-b243-ee8f05243499 req-7e0d5c1b-ff32-4d43-b041-ce37654ebecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:58.507732 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-62d31f58-4a43-4775-b243-ee8f05243499 req-7e0d5c1b-ff32-4d43-b041-ce37654ebecc service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:58.508184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-62d31f58-4a43-4775-b243-ee8f05243499 req-7e0d5c1b-ff32-4d43-b041-ce37654ebecc service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:58.523887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-62d31f58-4a43-4775-b243-ee8f05243499 req-7e0d5c1b-ff32-4d43-b041-ce37654ebecc service nova] Creating event network-changed:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 17:58:58.528907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-62d31f58-4a43-4775-b243-ee8f05243499 req-7e0d5c1b-ff32-4d43-b041-ce37654ebecc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039232 Jun 14 17:58:58.529689 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 56/112] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:58.577899 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:58.578763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:58.584907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:58.585366 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:58.586132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:58.586563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:58.643663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:58.644374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:58.650803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:58.651352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:58.652179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:58.652583 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:58.804518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:58.815973 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5873b218-bbd4-4a92-afa4-cbb250ad7d58 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1365 microversion: 2.1 time: 0.241844 Jun 14 17:58:58.818667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 57/113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:58 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:58:59.010639 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:58:59.018355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-352d358a-37cb-434e-8d3e-eb6adc028ad6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.380438 Jun 14 17:58:59.018942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 57/114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:58 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:58:59.293100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-1f4c67ff-c7c4-45a2-9866-ed1da9644acd req-94765035-d83c-4ca8-a6ca-d349aca76587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2412cb1-a36e-4e84-92d7-ca0c179b6993", "name": "network-vif-plugged", "status": "completed", "tag": "c319c807-d07b-43be-a8ee-999e7a34ee23"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:58:59.303954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-1f4c67ff-c7c4-45a2-9866-ed1da9644acd req-94765035-d83c-4ca8-a6ca-d349aca76587 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:59.305156 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-1f4c67ff-c7c4-45a2-9866-ed1da9644acd req-94765035-d83c-4ca8-a6ca-d349aca76587 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:59.322523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-1f4c67ff-c7c4-45a2-9866-ed1da9644acd req-94765035-d83c-4ca8-a6ca-d349aca76587 service nova] Creating event network-vif-plugged:c319c807-d07b-43be-a8ee-999e7a34ee23 for instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 on hv-cinder-82635 Jun 14 17:58:59.329041 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-1f4c67ff-c7c4-45a2-9866-ed1da9644acd req-94765035-d83c-4ca8-a6ca-d349aca76587 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039556 Jun 14 17:58:59.330346 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 58/115] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:58:59.836453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:58:59.837183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:58:59.864871 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:59.867908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:58:59.868855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:58:59.869305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:00.037782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:00.037782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:00.045154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:00.045605 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:00.047281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:00.048120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:00.101462 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:00.131792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e82870b2-df74-41b9-909b-eeb77a7d9fe0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1555 microversion: 2.1 time: 0.300101 Jun 14 17:59:00.132620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 58/116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:58:59 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1555 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:00.155684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:00.157163 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:00.167794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:00.168306 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:00.169163 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:00.169634 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:00.260686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:00.277234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-22e6adb5-811e-474e-bdb5-b6846a60198d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.245131 Jun 14 17:59:00.295504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 59/117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:00 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:00.297564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b8cd761b-d346-4b49-8cfa-0b3d86e63266 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144265 Jun 14 17:59:00.298849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 59/118] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 17:59:00 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:59:01.305599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:01.306451 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:01.312856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:01.313536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:01.314501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:01.315129 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:01.469521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:01.472352 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:01.479511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0751a240-c68f-46d6-9f9d-a8153262a0f6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1362 microversion: 2.1 time: 0.178872 Jun 14 17:59:01.480743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 60/119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:01 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:01.807903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-e9ce5d64-9dcb-4b9d-8fdb-5b0fdd7825ba req-f134e0e1-7113-476c-b3e9-ad542a1e3d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97278dbc-a791-43fb-b077-cd4f0a0bebf7", "tag": "308799a5-8ca4-4e1c-ae5f-b7ca777bdb74"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:01.817138 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-e9ce5d64-9dcb-4b9d-8fdb-5b0fdd7825ba req-f134e0e1-7113-476c-b3e9-ad542a1e3d4a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:01.817660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-e9ce5d64-9dcb-4b9d-8fdb-5b0fdd7825ba req-f134e0e1-7113-476c-b3e9-ad542a1e3d4a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:01.830789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-e9ce5d64-9dcb-4b9d-8fdb-5b0fdd7825ba req-f134e0e1-7113-476c-b3e9-ad542a1e3d4a service nova] Creating event network-changed:308799a5-8ca4-4e1c-ae5f-b7ca777bdb74 for instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 on hv-cinder-82635 Jun 14 17:59:01.836419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-e9ce5d64-9dcb-4b9d-8fdb-5b0fdd7825ba req-f134e0e1-7113-476c-b3e9-ad542a1e3d4a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032642 Jun 14 17:59:01.837387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 60/120] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:02.497265 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:02.498597 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:02.506964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:02.508453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:02.508453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:02.508670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:02.697168 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:02.718031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-09f06d6f-a9ce-425c-a24d-606ff6388b08 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1549 microversion: 2.1 time: 0.217792 Jun 14 17:59:02.719263 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 61/121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:02 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1549 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:02.736952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:02.737657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:02.744619 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:02.745071 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:02.745961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:02.746450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:02.848664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8d2e76e5-447d-46ba-b2e3-03b567c4a6e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116185 Jun 14 17:59:02.849357 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 61/122] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 17:59:02 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:03.943784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-f4049227-a319-433f-9d4a-fb812847607d req-b44d2a0c-9e07-4501-a46b-d2f0bb4c6d6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2412cb1-a36e-4e84-92d7-ca0c179b6993", "tag": "c319c807-d07b-43be-a8ee-999e7a34ee23"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:03.957973 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-f4049227-a319-433f-9d4a-fb812847607d req-b44d2a0c-9e07-4501-a46b-d2f0bb4c6d6c service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:03.958498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-f4049227-a319-433f-9d4a-fb812847607d req-b44d2a0c-9e07-4501-a46b-d2f0bb4c6d6c service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:03.974477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-f4049227-a319-433f-9d4a-fb812847607d req-b44d2a0c-9e07-4501-a46b-d2f0bb4c6d6c service nova] Creating event network-changed:c319c807-d07b-43be-a8ee-999e7a34ee23 for instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 on hv-cinder-82635 Jun 14 17:59:03.981426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-f4049227-a319-433f-9d4a-fb812847607d req-b44d2a0c-9e07-4501-a46b-d2f0bb4c6d6c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041491 Jun 14 17:59:03.988197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 62/123] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:09.821345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:09.822003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:09.828734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:09.829433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:09.830377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:09.830969 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:09.859930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 17:59:09.904628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:10.211257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e83c546c-c35c-4545-abac-10cc4cb4696d tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 204 len: 0 microversion: 2.1 time: 0.392903 Jun 14 17:59:10.213268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 62/124] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 17:59:09 2022] DELETE /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 17:59:10.224990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:10.227114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:10.241972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:10.242921 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:10.252800 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:10.252800 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:10.730356 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:10.743334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c54a6df7-f636-4fc8-ae3c-f9d55e6e2162 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1554 microversion: 2.1 time: 0.525306 Jun 14 17:59:10.743923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 63/125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:10 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1554 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:11.763491 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:11.764252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:11.779609 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:11.789096 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:11.789668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:11.791204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:11.791784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:12.104451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:12.115155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-3851eea2-2a51-4910-a37f-1f894a8de4dd tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1554 microversion: 2.1 time: 0.356706 Jun 14 17:59:12.116057 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 63/126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:11 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1554 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:13.141459 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:13.145232 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:13.173130 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:13.174721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:13.196508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:13.200838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:13.498453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:13.516719 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e6d9c076-ec21-469b-b927-0502eb8730b5 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1554 microversion: 2.1 time: 0.385549 Jun 14 17:59:13.518708 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 64/127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:13 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1554 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:13.654266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-2f46228c-c077-4397-bc80-0293a4b21c0b req-3bc34f69-8dd6-4ff5-9cee-d1128402d36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06d0dad6-e1ee-4577-884d-358d5ddf1981", "name": "network-vif-deleted", "tag": "5f12c6c5-21a6-45bb-9442-a7869565def7"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:13.665868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-2f46228c-c077-4397-bc80-0293a4b21c0b req-3bc34f69-8dd6-4ff5-9cee-d1128402d36a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:13.666415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-2f46228c-c077-4397-bc80-0293a4b21c0b req-3bc34f69-8dd6-4ff5-9cee-d1128402d36a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:13.684592 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-2f46228c-c077-4397-bc80-0293a4b21c0b req-3bc34f69-8dd6-4ff5-9cee-d1128402d36a service nova] Creating event network-vif-deleted:5f12c6c5-21a6-45bb-9442-a7869565def7 for instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 on hv-cinder-82635 Jun 14 17:59:13.691231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-2f46228c-c077-4397-bc80-0293a4b21c0b req-3bc34f69-8dd6-4ff5-9cee-d1128402d36a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040860 Jun 14 17:59:13.691874 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 64/128] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:14.537975 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:14.538905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:14.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:14.545887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:14.546408 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:14.547835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:14.548266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:14.627752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:14.636212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7f82ab2b-1f26-409a-a2e1-0c48cd6efead tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1346 microversion: 2.1 time: 0.102129 Jun 14 17:59:14.636820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 65/129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:14 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:15.657528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:15.659620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:15.669503 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:15.669966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:15.670844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:15.671329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:15.722098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:15.722833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:15.723627 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lazy-loading 'fault' on Instance uuid 06d0dad6-e1ee-4577-884d-358d5ddf1981 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 17:59:15.814807 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30552d1e358c41d1b99f22ba59dbd587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58d8bbe6d8a4352bde684e9878ae6ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:15.823383 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-501ee9c9-7ffc-43d9-bab6-e2e80b62e989 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 200 len: 1351 microversion: 2.1 time: 0.171971 Jun 14 17:59:15.832032 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 65/130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:15 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 1351 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:16.844210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:16.845102 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:16.851453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:16.851895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:16.852658 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:16.853082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:16.868655 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] HTTP exception thrown: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Request method failure captured: Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 HTTP/1.1 Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMwyjaasv_8LRYEnitZhLc2zmnRf0I8Sn00cvLl1qvkaEBNNRuzQYtoPxG94d6rBaKAlZYPBFImDuSiCx7Xr0nNXQ-ifsK1cA6aunu8nEwc22B36j9RQUkEBfCRkjhvb8qA7_xyE82cYGso1qvJXYMkBpiOX64pod-KwJ93BqA3M8ok Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 17:59:16.873226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a58d8bbe6d8a4352bde684e9878ae6ba", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 30552d1e358c41d1b99f22ba59dbd587 Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:16.874495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '06d0dad6-e1ee-4577-884d-358d5ddf1981'} Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:59:16.876025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:16.877999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:16.879644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Returning 404 to user: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:59:16.879644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9d6c36a9-f5ea-4041-bf33-0fa58df288e4 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 404 len: 111 microversion: 2.1 time: 0.036424 Jun 14 17:59:16.879644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 66/131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:16 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 17:59:17.061434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:17.063090 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:17.071402 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:17.071862 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:17.072665 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:17.073107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:17.088685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] HTTP exception thrown: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Request method failure captured: Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981/os-volume_attachments HTTP/1.1 Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMwyjaasv_8LRYEnitZhLc2zmnRf0I8Sn00cvLl1qvkaEBNNRuzQYtoPxG94d6rBaKAlZYPBFImDuSiCx7Xr0nNXQ-ifsK1cA6aunu8nEwc22B36j9RQUkEBfCRkjhvb8qA7_xyE82cYGso1qvJXYMkBpiOX64pod-KwJ93BqA3M8ok Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 17:59:17.093147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a58d8bbe6d8a4352bde684e9878ae6ba", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 30552d1e358c41d1b99f22ba59dbd587 Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:17.094875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'server_id': '06d0dad6-e1ee-4577-884d-358d5ddf1981'} Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:59:17.096171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:17.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:17.100935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Returning 404 to user: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:59:17.100935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-36348e76-93d2-4b29-aff2-560a098fd859 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037531 Jun 14 17:59:17.100935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 66/132] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 17:59:17 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 17:59:23.810635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:23.812331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:23.820133 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:23.820590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:23.821367 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:23.821951 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:23.837259 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] HTTP exception thrown: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Request method failure captured: Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 HTTP/1.1 Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMwyjaasv_8LRYEnitZhLc2zmnRf0I8Sn00cvLl1qvkaEBNNRuzQYtoPxG94d6rBaKAlZYPBFImDuSiCx7Xr0nNXQ-ifsK1cA6aunu8nEwc22B36j9RQUkEBfCRkjhvb8qA7_xyE82cYGso1qvJXYMkBpiOX64pod-KwJ93BqA3M8ok Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 17:59:23.838799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a58d8bbe6d8a4352bde684e9878ae6ba", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 30552d1e358c41d1b99f22ba59dbd587 Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.840059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '06d0dad6-e1ee-4577-884d-358d5ddf1981'} Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:59:23.840724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.841784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.843002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Returning 404 to user: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:59:23.843002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fc7e99ff-a572-47e2-ac97-050b810e6ba3 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "DELETE /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 404 len: 111 microversion: 2.1 time: 0.035433 Jun 14 17:59:23.843002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 67/133] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 17:59:23 2022] DELETE /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 17:59:23.849056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:23.849670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] [instance: 06d0dad6-e1ee-4577-884d-358d5ddf1981] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:23.856411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:23.856870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:23.857745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:23.858192 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:23.872825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] HTTP exception thrown: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Request method failure captured: Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 HTTP/1.1 Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMwyjaasv_8LRYEnitZhLc2zmnRf0I8Sn00cvLl1qvkaEBNNRuzQYtoPxG94d6rBaKAlZYPBFImDuSiCx7Xr0nNXQ-ifsK1cA6aunu8nEwc22B36j9RQUkEBfCRkjhvb8qA7_xyE82cYGso1qvJXYMkBpiOX64pod-KwJ93BqA3M8ok Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 17:59:23.874954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/a58d8bbe6d8a4352bde684e9878ae6ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_a58d8bbe6d8a4352bde684e9878ae6ba", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: a58d8bbe6d8a4352bde684e9878ae6ba Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-DeleteServersTestJSON-1886286568 Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 30552d1e358c41d1b99f22ba59dbd587 Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-DeleteServersTestJSON-1886286568-project Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.877161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '06d0dad6-e1ee-4577-884d-358d5ddf1981'} Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 17:59:23.887453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. Jun 14 17:59:23.889624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 17:59:23.891006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] Returning 404 to user: Instance 06d0dad6-e1ee-4577-884d-358d5ddf1981 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 17:59:23.891006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-01c92526-b691-4a11-a521-ff3564254da0 tempest-DeleteServersTestJSON-1886286568 tempest-DeleteServersTestJSON-1886286568-project] 10.222.0.36 "GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981" status: 404 len: 111 microversion: 2.1 time: 0.032647 Jun 14 17:59:23.891006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:23 2022] GET /compute/v2.1/servers/06d0dad6-e1ee-4577-884d-358d5ddf1981 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 17:59:35.374569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=5 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:35.375339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=31 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:35.504285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1330616164", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:35.557916 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] validate_networks() for [('de68c879-6907-4604-9b5a-490a31e5606e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:59:36.004979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:59:36.005656 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:59:36.006616 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:59:36.007228 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:59:36.008171 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:59:36.024846 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:36.032779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:36.032779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:36.032779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:36.053983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:59:36.058170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for user 7f214333671e4878bf613c26ceb1381a and project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:59:36.072523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:59:36.074797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:59:36.309669 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-87125578-2acf-4463-afe4-324a400b7a07 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.938432 Jun 14 17:59:36.311675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 68/135] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 17:59:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 17:59:36.323984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a8b82409-d707-4a05-90f4-ac0a4548cebb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:36.325795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a8b82409-d707-4a05-90f4-ac0a4548cebb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:36.342728 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=11 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:36.343824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=24,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:36.449996 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a8b82409-d707-4a05-90f4-ac0a4548cebb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:36.452868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a8b82409-d707-4a05-90f4-ac0a4548cebb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1222 microversion: 2.1 time: 0.134228 Jun 14 17:59:36.456227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 68/136] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:36 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:36.630065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1991678659", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:36.692858 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] validate_networks() for [('de68c879-6907-4604-9b5a-490a31e5606e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:59:37.257330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:59:37.257583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:59:37.258050 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:59:37.258447 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:59:37.261183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:59:37.268578 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:37.269020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:37.269797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:37.270226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:37.287268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:59:37.291347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for user 7f214333671e4878bf613c26ceb1381a and project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:59:37.303714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:59:37.305943 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:59:37.437472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3627a936-18df-4cbe-8fd1-cb0b5cb7aaea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.813899 Jun 14 17:59:37.439501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 69/137] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 17:59:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 17:59:37.451272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e78b7802-8dd8-4494-bd62-5fb83431447e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:37.452915 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e78b7802-8dd8-4494-bd62-5fb83431447e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:37.567010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e78b7802-8dd8-4494-bd62-5fb83431447e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:37.577043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e78b7802-8dd8-4494-bd62-5fb83431447e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1222 microversion: 2.1 time: 0.130773 Jun 14 17:59:37.577663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 69/138] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:37 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1222 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:38.603242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b52ae54a-e3ae-4e49-8542-504e54c5c484 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:38.608573 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b52ae54a-e3ae-4e49-8542-504e54c5c484 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:38.834762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b52ae54a-e3ae-4e49-8542-504e54c5c484 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:38.843041 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b52ae54a-e3ae-4e49-8542-504e54c5c484 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1222 microversion: 2.1 time: 0.252132 Jun 14 17:59:38.844097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 70/139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:38 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1222 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:39.862193 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:39.863850 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:39.872566 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:39.873279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:39.874296 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:39.874907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:39.978405 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:39.992107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ca1b7790-d7c2-40f4-bb9c-c6c6f30d62ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1274 microversion: 2.1 time: 0.134343 Jun 14 17:59:39.992715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 70/140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:39 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1274 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:41.011251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:41.013300 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:41.021326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:41.021962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:41.022963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:41.023674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:41.106285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:41.115683 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d4cfea1c-ae36-46e2-a838-4ac90b056a92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1282 microversion: 2.1 time: 0.109266 Jun 14 17:59:41.116508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 71/141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:41 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1282 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:42.137620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:42.138293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:42.155120 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:42.155638 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:42.156454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:42.156935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:42.426031 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:42.434585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-871ce487-d737-4219-a511-92a3f3c55576 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.301223 Jun 14 17:59:42.435169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:42 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:43.222188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:43.222188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:43.230194 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-f542d76b-349a-4752-8ed1-ad0c5da83351 req-1a7ecbaf-13f1-4519-be29-4fa0ecf9be87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e01abb-08b2-4506-8fae-b466262f45e4", "tag": "84989334-15c6-4afc-bfd1-f3a512ae930d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:43.252327 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:43.264409 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:43.264409 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:43.264409 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:43.266014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-f542d76b-349a-4752-8ed1-ad0c5da83351 req-1a7ecbaf-13f1-4519-be29-4fa0ecf9be87 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:43.267705 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-f542d76b-349a-4752-8ed1-ad0c5da83351 req-1a7ecbaf-13f1-4519-be29-4fa0ecf9be87 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:43.309158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-f542d76b-349a-4752-8ed1-ad0c5da83351 req-1a7ecbaf-13f1-4519-be29-4fa0ecf9be87 service nova] Creating event network-changed:84989334-15c6-4afc-bfd1-f3a512ae930d for instance 59e01abb-08b2-4506-8fae-b466262f45e4 on hv-cinder-82635 Jun 14 17:59:43.321957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-f542d76b-349a-4752-8ed1-ad0c5da83351 req-1a7ecbaf-13f1-4519-be29-4fa0ecf9be87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095953 Jun 14 17:59:43.323517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 72/143] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:43.610257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c1321e06-8440-4a7c-87db-6fbc84647ab7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/ips" status: 200 len: 152 microversion: 2.20 time: 0.175153 Jun 14 17:59:43.610257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 72/144] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jun 14 17:59:43 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/ips => generated 152 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 17:59:43.613525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:43.613525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:43.613525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:43.613525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:43.613917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:43.613917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:43.700205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:43.700205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5dd3ba29-3852-442c-8f56-11cea205478b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.251602 Jun 14 17:59:43.701039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 73/145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:43 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:59:44.724758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:44.724758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:44.731062 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:44.731728 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:44.732741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:44.733506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:44.884950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:44.893603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9d83eebf-d7b9-4238-bcf4-a9b498dc9daa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.176078 Jun 14 17:59:44.894274 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:44 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:45.361985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-68e1ff84-5d20-4b63-9d59-78cfc35d413a req-6a6627c4-fc00-484c-98dc-70b1245e0346 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c951fcf6-4f2e-44a1-a20e-9304f7e17601", "tag": "fd70d92c-2049-469f-8632-d7ee600eb05e"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:45.371228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-68e1ff84-5d20-4b63-9d59-78cfc35d413a req-6a6627c4-fc00-484c-98dc-70b1245e0346 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:45.371875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-68e1ff84-5d20-4b63-9d59-78cfc35d413a req-6a6627c4-fc00-484c-98dc-70b1245e0346 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:45.386659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-68e1ff84-5d20-4b63-9d59-78cfc35d413a req-6a6627c4-fc00-484c-98dc-70b1245e0346 service nova] Creating event network-changed:fd70d92c-2049-469f-8632-d7ee600eb05e for instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 on hv-cinder-82635 Jun 14 17:59:45.392041 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-68e1ff84-5d20-4b63-9d59-78cfc35d413a req-6a6627c4-fc00-484c-98dc-70b1245e0346 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034810 Jun 14 17:59:45.398148 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 74/147] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:45.637540 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1652442807", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "networks": [{"uuid": "4d337caa-bf92-4f7f-8794-6bc4677d3709"}]}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:45.693161 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] validate_networks() for [('4d337caa-bf92-4f7f-8794-6bc4677d3709', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 17:59:45.913626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:45.914162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:45.921810 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:45.922338 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:45.930366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:45.931033 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:46.110415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:46.126305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e2673cd2-1e73-4e12-9a2b-4edec149a265 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.215910 Jun 14 17:59:46.126305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 75/148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:45 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:46.177082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:46.177616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:46.185161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:46.189004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:46.189004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:46.189004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:46.211510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lazy-loading 'flavor' on Instance uuid 105cfea1-617b-4c5a-b63a-df8eda1907bd {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 17:59:46.225373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 17:59:46.225914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 17:59:46.226252 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 17:59:46.226652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 17:59:46.227749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 17:59:46.245677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:46.246249 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:46.247425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:46.248153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:46.284802 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Getting quotas for project 5a142734eadd40fb908c7bd115c81ee4. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 17:59:46.289530 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Getting quotas for user e73368f3ce8a43368b30985898cf7393 and project 5a142734eadd40fb908c7bd115c81ee4. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 17:59:46.303333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 17:59:46.308541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 17:59:46.505686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8126bfbd-2c88-4757-9ba5-fa338bd88109 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872112 Jun 14 17:59:46.512273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 74/149] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 17:59:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 17:59:46.518755 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-abd31636-233e-4997-b024-01332d2d1c9b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:46.522108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-abd31636-233e-4997-b024-01332d2d1c9b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:46.590687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-abd31636-233e-4997-b024-01332d2d1c9b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:46.600545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-abd31636-233e-4997-b024-01332d2d1c9b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1219 microversion: 2.1 time: 0.085971 Jun 14 17:59:46.601113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:46 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:46.908395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-471d14ca-77e1-47b4-b40e-6bbccc8a46ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/action" status: 202 len: 0 microversion: 2.20 time: 0.734760 Jun 14 17:59:46.910973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 76/151] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 14 17:59:46 2022] POST /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/action => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 17:59:46.918179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:46.919112 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:46.926704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:46.927162 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:46.927974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:46.928417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:47.085737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:47.103518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:47.103518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:47.103518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-87bcc20b-96b6-45d6-ae58-5b22277c77d5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.184009 Jun 14 17:59:47.103912 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 76/152] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:46 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:47.144439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:47.145166 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:47.153077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:47.154075 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:47.155036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:47.155516 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:47.307222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:47.322270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2c5040da-bdff-4b3f-a048-09f2b16ce2ce tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.176911 Jun 14 17:59:47.323572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 77/153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:47 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:47.619425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-457917ca-3779-42a2-931e-4ff3c8ca9cb4 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:47.620030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-457917ca-3779-42a2-931e-4ff3c8ca9cb4 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:47.673340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-457917ca-3779-42a2-931e-4ff3c8ca9cb4 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:47.680276 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-457917ca-3779-42a2-931e-4ff3c8ca9cb4 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1219 microversion: 2.1 time: 0.064611 Jun 14 17:59:47.680725 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 77/154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:47 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:48.121138 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:48.121759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:48.124161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=4 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:48.129755 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.130206 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.130985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.131455 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.288098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:48.296319 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:48.297842 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:48.299475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-539a066b-e44b-4054-ad21-71e24ec1ea68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.182019 Jun 14 17:59:48.300031 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 78/155] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:48 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:48.346832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:48.347738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:48.354722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.355203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.356037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.356462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.484308 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:48.484308 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:48.489931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.490315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.491492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.491934 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.500744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:48.510495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2ae3304c-a16f-4778-b78a-3dc60871acb6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.168381 Jun 14 17:59:48.511072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 78/156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:48 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:48.524722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-25325cf7-77b9-43c4-9dbd-96322a1ee322 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/ips" status: 200 len: 149 microversion: 2.1 time: 0.046698 Jun 14 17:59:48.530159 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 79/157] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 17:59:48 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:48.697647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:48.698285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:48.705272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.705724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.706504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:48.707329 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:48.773019 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:48.780780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cb1badb3-77b2-40c2-b0f2-f6704ff76ac3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1223 microversion: 2.1 time: 0.087195 Jun 14 17:59:48.781293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 79/158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:48 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:49.319171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:49.328507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:49.331588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.332553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.332831 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.333274 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.529796 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:49.531920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:49.554812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.555675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.557877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.559339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.633895 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:49.657665 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:49.666327 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:49.668415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0767a318-6c77-45eb-904f-2681e7017b6e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.353494 Jun 14 17:59:49.669635 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 80/159] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:49 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:49.686916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-ffd0cd27-8c26-4fbb-b1af-5df305deef3d req-55b590e1-99ce-47bb-a703-8dd0d80b709b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e01abb-08b2-4506-8fae-b466262f45e4", "name": "network-vif-plugged", "status": "completed", "tag": "84989334-15c6-4afc-bfd1-f3a512ae930d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:49.697419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-ffd0cd27-8c26-4fbb-b1af-5df305deef3d req-55b590e1-99ce-47bb-a703-8dd0d80b709b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.697957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-ffd0cd27-8c26-4fbb-b1af-5df305deef3d req-55b590e1-99ce-47bb-a703-8dd0d80b709b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.716369 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-ffd0cd27-8c26-4fbb-b1af-5df305deef3d req-55b590e1-99ce-47bb-a703-8dd0d80b709b service nova] Creating event network-vif-plugged:84989334-15c6-4afc-bfd1-f3a512ae930d for instance 59e01abb-08b2-4506-8fae-b466262f45e4 on hv-cinder-82635 Jun 14 17:59:49.724779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-ffd0cd27-8c26-4fbb-b1af-5df305deef3d req-55b590e1-99ce-47bb-a703-8dd0d80b709b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053674 Jun 14 17:59:49.726317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 81/160] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:49.758740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:49.767218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-303bf72f-96f8-46ea-854b-64c44cc6e16e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.241659 Jun 14 17:59:49.768834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 80/161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:49 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:49.799751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:49.800721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:49.809312 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.809962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.810901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:49.811670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:49.901050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:49.909436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-13ad846c-a9a4-4bc4-bea4-f0de2e7f0d18 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1215 microversion: 2.1 time: 0.114522 Jun 14 17:59:49.910028 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 82/162] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:49 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:50.464946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d18715c6-5143-44d3-ae89-fcddbe347f3e"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:50.466096 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:50.478211 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.479280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.480125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.480571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.513555 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:50.514052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:50.521597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.522055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.522840 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.523282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.551995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cf0ff782-ad17-4c60-85a3-219a6693f0a0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/ips" status: 200 len: 147 microversion: 2.1 time: 0.042260 Jun 14 17:59:50.552540 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 83/163] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 17:59:50 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 17:59:50.687088 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:50.688694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:50.696581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.697089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.697868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.698340 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.953491 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:50.967158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:50.970795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:50.970795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f48d60a8-9f8b-4921-a5f1-bd29d241130f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.287640 Jun 14 17:59:50.971268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 84/164] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:50 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 17:59:50.977962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:50.977962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:50.983013 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.983489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:50.984253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:50.984730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:51.128019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:51.135507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a77714d9-7122-49df-9a84-7d68c678113e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.163189 Jun 14 17:59:51.136064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 85/165] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:50 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:51.140624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:51.141894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:51.148394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:51.149186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:51.149682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:51.150123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:51.218773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:51.222962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-57860724-0e52-49d3-aecf-68d56431c921 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1289 microversion: 2.1 time: 0.085811 Jun 14 17:59:51.228454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 86/166] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:51 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:51.675151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-99e9583d-d57b-489d-8c10-2b96dd0196b8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215812 Jun 14 17:59:51.675974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 81/167] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 17:59:50 2022] POST /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments => generated 194 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:51.991206 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:51.991978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:51.998541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:51.999087 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:52.000161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:52.000759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:52.005660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:52.150154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:52.154381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:52.155314 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:52.161422 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:52.163211 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:52.163809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:52.164480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:52.164667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:52.164964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:52.166711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9cb540a0-91a4-4df8-a5a1-0450d50bcd2b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.179151 Jun 14 17:59:52.180228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 87/168] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:51 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 17:59:52.249015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:52.249015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:52.255268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:52.257216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:52.257532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:52.258036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:52.355238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:52.367655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c8296d8d-a3f4-4207-afa8-a1b23c1dc389 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1289 microversion: 2.1 time: 0.130190 Jun 14 17:59:52.368248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 88/169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:52 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:52.639619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:52.659706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-dfc40ba3-fca0-4483-aebc-96395bab7672 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.499198 Jun 14 17:59:52.659706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 82/170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:52 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:59:53.186393 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:53.187616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:53.195321 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:53.195848 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:53.196721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:53.197209 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:53.346064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:53.355331 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:53.357351 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:53.358616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-17d74386-294d-474a-ba25-44c87174b9f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.176539 Jun 14 17:59:53.360023 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 89/171] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:53 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:53.388257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:53.389033 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:53.396979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:53.397498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:53.398498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:53.400757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:53.476145 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:53.488750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-47221cac-c4f7-4014-8bf3-253df7553394 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1289 microversion: 2.1 time: 0.105576 Jun 14 17:59:53.490151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 83/172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:53 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1289 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:53.667242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:53.668199 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:53.676560 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:53.676769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:53.677765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:53.678216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:53.866571 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:53.875343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4d558de9-f73e-4051-b63d-72ba4b8370d7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.211974 Jun 14 17:59:53.885739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 90/173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:53 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:54.378720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:54.379435 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:54.386657 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:54.386657 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:54.387036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:54.398630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:54.507092 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:54.508607 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:54.520880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:54.521938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:54.522978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:54.523644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:54.627993 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:54.637099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d436c32d-15c9-4776-8524-ba95be9c3b65 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1277 microversion: 2.1 time: 0.133852 Jun 14 17:59:54.638453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 91/174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:54 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:59:54.753651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:54.810466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:54.833680 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:54.835882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8ef014b1-360a-4021-885e-75f3224c088d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.461550 Jun 14 17:59:54.836807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 84/175] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:54 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:54.897268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:54.910582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:54.931580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:54.932747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:54.934464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:54.936170 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:55.241636 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:55.259675 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-395364a1-375b-4fb4-bd80-7b5c734b5334 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.369603 Jun 14 17:59:55.277823 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 92/176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:54 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:55.667569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:55.669644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:55.690260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:55.691470 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:55.694572 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:55.695995 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:55.856187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:55.856798 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:55.869095 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:55.869719 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:55.874215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:55.876717 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:56.130865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:56.140734 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4a06f1f7-5f3f-464c-974b-813b8955d212 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.486140 Jun 14 17:59:56.142502 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 85/177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:55 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:56.148287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-53ec16ac-ef64-41cc-a336-11f5b2168914 req-ee396414-0487-4b10-a4b5-ff6b2ffed229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c951fcf6-4f2e-44a1-a20e-9304f7e17601", "name": "network-vif-plugged", "status": "completed", "tag": "fd70d92c-2049-469f-8632-d7ee600eb05e"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:56.157700 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-53ec16ac-ef64-41cc-a336-11f5b2168914 req-ee396414-0487-4b10-a4b5-ff6b2ffed229 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:56.158199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-53ec16ac-ef64-41cc-a336-11f5b2168914 req-ee396414-0487-4b10-a4b5-ff6b2ffed229 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:56.171749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-53ec16ac-ef64-41cc-a336-11f5b2168914 req-ee396414-0487-4b10-a4b5-ff6b2ffed229 service nova] Creating event network-vif-plugged:fd70d92c-2049-469f-8632-d7ee600eb05e for instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 on hv-cinder-82635 Jun 14 17:59:56.178234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-53ec16ac-ef64-41cc-a336-11f5b2168914 req-ee396414-0487-4b10-a4b5-ff6b2ffed229 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033802 Jun 14 17:59:56.187520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 86/178] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:56.286358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:56.302723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:56.304236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:56.322289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:56.325010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:56.333229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:56.337649 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:56.707478 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:56.724444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:56.726083 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:56.727164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-feef7876-3d59-40dc-a6b5-66af10328441 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.875247 Jun 14 17:59:56.731660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 93/179] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:55 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:56.882369 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4457390-52c4-47e9-a722-cdcea140c312"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:56.884233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:56.912142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:56.916068 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:56.917162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:56.917774 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:56.973551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:56.989170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8047905e-5c6c-471b-81d3-b18c6ddfd5a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.704723 Jun 14 17:59:56.992600 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 87/180] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:56 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:57.163174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:57.164113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:57.177158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:57.181413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:57.184967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:57.185642 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:57.510972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:57.522588 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a839f179-d44b-41ad-b72c-49a6612da905 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.363999 Jun 14 17:59:57.535408 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 88/181] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:57 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:59:57.756014 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:57.757185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:57.762972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=24 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:57.771631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:57.772513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:57.773891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:57.775276 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:57.784607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:58.068388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:58.077219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:58.078738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:58.080775 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-81062335-bab4-41dd-ac66-245e204eafdb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.334837 Jun 14 17:59:58.081350 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 89/182] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:57 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:58.102203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-5d3fe6a3-dfbb-41df-9948-9b13dd0a36dc req-3b39da5e-cbf0-4857-8e4d-af8e85078a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfba6f52-c4c7-410c-8d59-4fd9e65c3664", "tag": "cb2971f9-bb02-4c16-9542-d77ac944d293"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 17:59:58.117895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-5d3fe6a3-dfbb-41df-9948-9b13dd0a36dc req-3b39da5e-cbf0-4857-8e4d-af8e85078a62 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:58.119174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-5d3fe6a3-dfbb-41df-9948-9b13dd0a36dc req-3b39da5e-cbf0-4857-8e4d-af8e85078a62 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:58.150820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-5d3fe6a3-dfbb-41df-9948-9b13dd0a36dc req-3b39da5e-cbf0-4857-8e4d-af8e85078a62 service nova] Creating event network-changed:cb2971f9-bb02-4c16-9542-d77ac944d293 for instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 on hv-cinder-82635 Jun 14 17:59:58.192800 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-5d3fe6a3-dfbb-41df-9948-9b13dd0a36dc req-3b39da5e-cbf0-4857-8e4d-af8e85078a62 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101179 Jun 14 17:59:58.194247 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 90/183] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:58.206081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:58.207423 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:58.220198 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:58.221030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:58.224040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:58.224542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:58.443408 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:58.458187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-dcdaf3bf-5627-4072-ab52-029d5539ad5a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.260927 Jun 14 17:59:58.460825 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 91/184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:58 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:58.543441 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:58.544850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:58.555582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:58.556173 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:58.557704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:58.558367 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:58.599122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-41b0e593-2286-49c7-a15a-2a3fba3c83c5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.720459 Jun 14 17:59:58.600001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 94/185] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 17:59:56 2022] POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-volume_attachments => generated 194 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 17:59:58.872538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:58.896286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-19759a2a-d93f-4e35-a497-6d8c5b76569d tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.349014 Jun 14 17:59:58.898178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 92/186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:58 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 17:59:59.106939 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:59.111852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:59.127261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:59.137197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:59.137197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:59.137197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:59.371877 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:59.383050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:59.384664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:59.386117 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ed1f0be5-45de-475b-9d32-370fbf589911 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.290138 Jun 14 17:59:59.394736 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 95/187] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 17:59:59 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 17:59:59.480294 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:59.480946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:59.498131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 17:59:59.498131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:59.498131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:59.498131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:59.498568 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:59.664780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 17:59:59.673242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5b385450-6b66-48c9-b348-228fd1a6a125 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.197027 Jun 14 17:59:59.673816 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 93/188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:59 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 17:59:59.928016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 17:59:59.928016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 17:59:59.932225 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:59.932691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 17:59:59.933479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 17:59:59.934082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:00.197775 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:00.208675 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-70f4efa0-6fb2-408f-b2f9-fc286b2f028b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.290739 Jun 14 18:00:00.209315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 96/189] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 17:59:59 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:00.409542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:00.410263 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:00.441069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:00.441530 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:00.442332 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:00.444179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:00.604516 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:00.614257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:00.616227 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:00.623022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4f846433-7aac-48e9-a26b-b66b5ae179ec tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.213984 Jun 14 18:00:00.623022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 94/190] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:00 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:00.696982 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:00.698052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:00.709846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:00.710667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:00.712355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:00.713298 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:00.975080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:00.984966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-60fb5575-6282-47d8-8e43-8ec820ecbea7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1322 microversion: 2.1 time: 0.296649 Jun 14 18:00:00.997492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 97/191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:00 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:01.227226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:01.227908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:01.234639 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:01.235603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:01.236581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:01.237004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:01.503108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:01.512064 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1248af47-032d-4d26-8012-bafa351abd5c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.288537 Jun 14 18:00:01.512856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 95/192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:01 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:01.640661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:01.641429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:01.651284 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:01.652786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:01.654163 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:01.655399 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.010174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:02.011220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:02.022009 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.022559 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.023520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.024039 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.094793 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:02.114434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:02.119594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:02.123195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-68b28411-eed9-4219-9834-6eae3fe62c75 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.486089 Jun 14 18:00:02.125273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 98/193] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:01 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:02.244557 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:02.254861 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e70d92e8-4eb5-4f3e-b2cd-64f94894a623 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1517 microversion: 2.1 time: 0.251287 Jun 14 18:00:02.257187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 96/194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:02 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1517 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:02.275332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:02.276782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:02.286665 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.287110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.304986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.305448 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.345321 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'flavor' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:00:02.535790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:02.538492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:02.557610 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.558714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.561155 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.563081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.829553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-53ee720e-4868-479a-8c6a-c78439167ed2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601/action" status: 200 len: 32 microversion: 2.1 time: 0.557786 Jun 14 18:00:02.835504 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 99/195] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:00:02 2022] POST /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601/action => generated 32 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:00:02.850562 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:02.857240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:02.883123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.884615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.887582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:02.888243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:02.959455 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:02.970825 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c858fc21-4a58-4325-9af0-2acff4cd8d83 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.443815 Jun 14 18:00:02.972343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:02.973200 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 97/196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:02 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:03.157539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:03.159808 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:03.168522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:03.169297 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:03.170515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:03.171155 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:03.461747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:03.472763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:03.474735 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:03.476648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5d555b98-5eb8-4405-b1a6-817dd424abc0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.325648 Jun 14 18:00:03.477512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 98/197] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:03 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:03.513884 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b4170bd3-fc8f-4eeb-b011-e2a31c463c16 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: .version_select at 0x7fbafcac0dc0>, body: {"keypair": {"name": "tempest-keypair-698912452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAfUca8WtTTR08jALzLl+pFtQGSjddUH6nmudP/Sq88jBb+ZUDYSkDajzQzIR5WwR5Of7apr60cOa/b4WfKqkKdOu/wbIy9gwkkMr0iEzVrPBv3Cy+DdTm6M19aqWGNsJw=="}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:03.532949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-b4170bd3-fc8f-4eeb-b011-e2a31c463c16 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:00:03.538693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-b4170bd3-fc8f-4eeb-b011-e2a31c463c16 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:00:03.676925 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:03.691564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0f89dd31-403c-4bc9-8b43-e36351b92c22 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.854907 Jun 14 18:00:03.692683 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 100/198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:02 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:03.737904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b4170bd3-fc8f-4eeb-b011-e2a31c463c16 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.227823 Jun 14 18:00:03.739524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 99/199] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:00:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:04.003387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:04.003387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:04.012000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:04.012558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:04.013430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:04.014008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:04.233231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:04.263373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d5612473-7b32-4a1d-bade-80c2bef2d0d0 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.266900 Jun 14 18:00:04.280039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 101/200] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:03 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:04.499792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:04.500659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:04.508073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:04.508786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:04.509762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:04.510358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:04.723534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:04.724478 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:04.766238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:04.779673 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:04.781724 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:04.782841 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:04.926195 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:04.944002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:04.946339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:04.948119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7d984cec-6a76-4766-8002-bf9815f675ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.453676 Jun 14 18:00:04.956644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 100/201] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:04 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:05.290913 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:05.291595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:05.307023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:05.307523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:05.308348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:05.308793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:05.525386 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:05.538192 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a77c8163-ed67-44d3-8b38-dbcd2037e766 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.251100 Jun 14 18:00:05.539210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 101/202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:05 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:05.639644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:05.651113 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e040c25b-9cac-453d-96e2-8d519a9505d4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.936306 Jun 14 18:00:05.652096 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 102/203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:04 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:05.986229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:05.991100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:05.999920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:06.000730 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:06.002117 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:06.002925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:06.531623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:06.562990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:06.563887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:06.567684 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c894145b-fca1-4ad3-b248-c132a68935af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.588911 Jun 14 18:00:06.571387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:06.572606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:06.582560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 102/204] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:05 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:06.585384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:06.585845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:06.586740 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:06.587267 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:06.674588 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:06.675490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:06.685506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:06.686166 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:06.687197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:06.687766 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:06.817519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:06.833805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a3eaad50-7fb5-4fef-8cea-86effb9cf3e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.266151 Jun 14 18:00:06.848561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 103/205] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:06 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:07.057619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:07.071800 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a2a3e9c4-5e43-4ef8-aba0-3a8614332890 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.401384 Jun 14 18:00:07.073141 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 103/206] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:06 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:07.590051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:07.592318 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:07.605000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:07.606158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:07.608168 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:07.609217 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:07.839075 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1255064622", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0964eb9b-e0dc-493c-8b01-2ac272fdf32e"}], "security_groups": [{"name": "tempest-securitygroup--1408924374"}], "key_name": "tempest-keypair-698912452", "user_data": "}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:07.962196 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:07.974006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:07.976059 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:07.978108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ebd227c8-c3a7-46f6-985a-aebb2d8bb516 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.394927 Jun 14 18:00:07.979063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 104/207] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:07 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:07.979239 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] validate_networks() for [('0964eb9b-e0dc-493c-8b01-2ac272fdf32e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:00:07.987995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:07.988893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:07.997745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:07.998537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:08.000122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:08.002493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:08.450397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:08.465200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-973455a3-0b76-420a-83bf-777fc56ce261 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.484499 Jun 14 18:00:08.465924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 105/208] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:07 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:08.475526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:08.476397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:08.485139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:08.486062 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:08.487161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:08.487859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:08.725923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:00:08.725923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:00:08.726931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:00:08.727682 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:00:08.728485 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:00:08.756779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:08.757336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:08.762363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:08.763009 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:08.808506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:00:08.818051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:00:08.851430 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:00:08.858823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:00:08.991899 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-45c18e4b-eda5-4340-89c2-8b901b337ff0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.161320 Jun 14 18:00:08.998609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 104/209] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:00:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:00:09.005396 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:09.006480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:09.015475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:09.016401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:09.017626 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:09.018325 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:09.085755 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:09.097042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9d26fa50-4292-474f-a17e-8ada36957d2c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.628806 Jun 14 18:00:09.097645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 106/210] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:08 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:09.116358 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-78d254bc-bba5-400e-a024-f448a2d95cc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:09.116987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-78d254bc-bba5-400e-a024-f448a2d95cc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:09.270834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:09.281976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:09.284539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:09.285841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2e856ea1-0e55-4b07-a9bf-9db50f896e7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1745 microversion: 2.20 time: 0.285761 Jun 14 18:00:09.286784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 105/211] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:08 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1745 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:09.289976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-78d254bc-bba5-400e-a024-f448a2d95cc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:09.298100 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-78d254bc-bba5-400e-a024-f448a2d95cc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1241 microversion: 2.1 time: 0.199335 Jun 14 18:00:09.298736 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 107/212] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:09 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1241 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:09.504283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:09.505275 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:09.519749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:09.520647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:09.522481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:09.523365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:09.871822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:09.925785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b237d42b-4b7a-4967-9421-e9247181acc5 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.429541 Jun 14 18:00:09.928922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 106/213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:09 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:09.984178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-517555b7-48b2-491f-869e-cb3ceff39d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Action: 'create', calling method: .version_select at 0x7fbafc24e3a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-922967960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODLs4a5At/EmayEWfO5MvhkOkSFPXv/aAL3cDtzEtM8h68Jrq6pch6yEv9sMYbdM1woaBrZgF6Gl730vR24Zo1BL6BJ38dIVkN/3tfV8bQR+Ae4jDn2t1oNuNSdzsp8AA=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:09.990405 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=87 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:10.006142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-517555b7-48b2-491f-869e-cb3ceff39d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Getting quotas for project add35554d0514dc59890c61894593313. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:00:10.010905 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-517555b7-48b2-491f-869e-cb3ceff39d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Getting quotas for user e6b1c08311384aa39ad01a8378c9a056 and project add35554d0514dc59890c61894593313. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:00:10.134772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:10.135876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-517555b7-48b2-491f-869e-cb3ceff39d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.466357 Jun 14 18:00:10.136619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:10.137103 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 108/214] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:00:09 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:00:10.178641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.184113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.187856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.189295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.322434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:10.323533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:10.337920 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.339135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.340832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.341962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.492476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:10.506925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d33ec72f-4a3d-4a8c-9161-4f0a6cd3801a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.385661 Jun 14 18:00:10.523867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 107/215] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:10 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:10.534822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:10.536444 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:10.550768 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.564280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.565020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.565847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.576092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:10.642429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:10.666103 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:10.667411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:10.670397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-94681d88-200e-4cca-941b-83c5f12af951 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1745 microversion: 2.20 time: 0.368565 Jun 14 18:00:10.673703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 109/216] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:10 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1745 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:10.773139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:10.797454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-dd070962-d58c-4afd-b3e5-e539db5ad0f7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1245 microversion: 2.1 time: 0.270209 Jun 14 18:00:10.799221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 108/217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:10 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1245 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:10.957227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:10.958288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:10.971330 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.972980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:10.975065 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:10.976190 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.354472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:11.368014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-757838af-446b-47fe-977e-b340675526ab tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.417770 Jun 14 18:00:11.369287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 110/218] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:10 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:11.532991 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:11.533607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:11.541252 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:11.541710 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.542526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:11.542970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.696430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:11.697336 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:11.708099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:11.708595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.709619 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:11.710260 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.711012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:11.719558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-eb50f2c9-62e7-4e31-8f33-669fef111cc8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.190637 Jun 14 18:00:11.720865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 109/219] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:11 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:11.833450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:11.834370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:11.852337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:11.856206 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.860631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:11.861594 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:11.993898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:12.014289 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:12.019016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:12.026297 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-83c5e8a8-6faf-41c7-808f-4b0d607f22e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1745 microversion: 2.20 time: 0.338405 Jun 14 18:00:12.028148 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 111/220] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:11 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1745 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:12.049885 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:12.069689 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-292bf9cd-4d73-45b6-a3fd-f379ae8402f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1293 microversion: 2.1 time: 0.246680 Jun 14 18:00:12.070779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 110/221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:11 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1293 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:12.357768 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c1c3545b-1989-4643-822d-dd5eed409d50 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:12.370825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c1c3545b-1989-4643-822d-dd5eed409d50 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.371656 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c1c3545b-1989-4643-822d-dd5eed409d50 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:12.386365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:12.387905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:12.397072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.397765 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:12.401392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.402005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:12.488804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c1c3545b-1989-4643-822d-dd5eed409d50 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Going to try to stop instance {{(pid=125162) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 14 18:00:12.656938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:12.672716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-748677aa-d087-491c-80cf-e2d6349020ca tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.289904 Jun 14 18:00:12.674530 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 111/222] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:12 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:12.727626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c1c3545b-1989-4643-822d-dd5eed409d50 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action" status: 202 len: 0 microversion: 2.1 time: 0.377270 Jun 14 18:00:12.728889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 112/223] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:00:12 2022] POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:00:12.742517 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:12.748007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:12.764437 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:12.776102 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:12.784042 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.785338 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:12.787085 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.788234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:12.809232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.810501 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:12.814730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:12.820632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.090502 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.103905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fb9e7fa7-8cea-4a99-97c3-102dbdf3f240 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.369970 Jun 14 18:00:13.104852 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 112/224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:12 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:13.110340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:13.116848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:13.123754 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:13.124740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.126262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:13.126857 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.187510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.205994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d0fd85ad-ec2c-45cb-a66f-b8c35c3089fb tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.459680 Jun 14 18:00:13.208748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 113/225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:12 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:13.229913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:13.230537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:13.244286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:13.245024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.246071 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:13.246511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.346103 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.352380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.359016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-04e6ed37-a17b-4722-8699-f4875356b7d5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1293 microversion: 2.1 time: 0.147974 Jun 14 18:00:13.360088 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 114/226] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:13 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:13.376871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.378596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.379887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7a55759b-8586-45ab-8738-e2f5d9ae845d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.273554 Jun 14 18:00:13.380847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 113/227] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:13 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:13.701184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:13.701958 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:13.709758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:13.710240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.711034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:13.711826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:13.893608 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:13.907071 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0fd3d723-1fda-489d-9e76-78a61bd47d91 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.208085 Jun 14 18:00:13.909836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 115/228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:13 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:14.128060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:14.128775 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:14.136538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.137159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.137771 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.138210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.236677 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:14.238043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:14.246852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.247705 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.248648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.249213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.348261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:14.365904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2beb15af-4c1f-4771-a945-c84b2c174663 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.242086 Jun 14 18:00:14.367072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 114/229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:14 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:14.385629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:14.386931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:14.396972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.397605 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.398797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.399512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.501272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:14.515598 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6370afa7-072f-4daf-b87f-283284c0f319 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1293 microversion: 2.1 time: 0.135048 Jun 14 18:00:14.518374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 115/230] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:14 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:14.543209 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:14.544424 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:14.558324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.559492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.560984 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.561856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.737262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:14.756024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c5d781b5-3ac6-43ca-b2e9-752cd336b4ea tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.526266 Jun 14 18:00:14.757197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 116/231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:14 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:14.809921 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:14.830230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:14.833746 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:14.836054 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-32f7ee77-dfc6-4777-aac3-2a94349aed86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.314986 Jun 14 18:00:14.837306 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 116/232] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:14 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:14.926919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:14.928129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:14.936450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.936909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:14.939169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:14.939866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.102070 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:15.117414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8ab15c30-e9eb-4fc1-846d-b05ed840d369 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.195138 Jun 14 18:00:15.119027 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 117/233] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:14 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:15.406199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:15.407957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:15.429837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.431421 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.433185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.434218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.553563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:15.556011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:15.589191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.592292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.594410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.599837 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.643778 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:15.775411 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:15.803238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ad71c9fe-141e-464b-ad3b-229eb1452ae5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.401797 Jun 14 18:00:15.805733 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 117/234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:15 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:15.817837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:15.820640 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:15.837178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.838551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.840536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.841634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.862728 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:15.901227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ed5235b2-4304-4508-b8ac-c4ef9f8142db tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1301 microversion: 2.1 time: 0.342836 Jun 14 18:00:15.901227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 118/235] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:15 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1301 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:15.926902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:15.928857 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:15.966663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.967132 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:15.968037 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:15.968489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.237920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:16.263898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-34ebec79-c129-4326-84f8-d6a85025dfb9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.454052 Jun 14 18:00:16.263898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 118/236] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:15 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:16.276719 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:16.277668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:16.303939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.303939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.303939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.303939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.461678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:16.480948 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:16.487293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:16.497472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1c00e71d-9296-4be4-b5d1-499228712a4f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.593206 Jun 14 18:00:16.509563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 119/237] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:15 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:16.534919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-204cee84-01bc-4665-81aa-40408b3aa5d5 req-cc625de4-2a01-47d5-94c0-a2a460af1951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfba6f52-c4c7-410c-8d59-4fd9e65c3664", "name": "network-vif-plugged", "status": "completed", "tag": "cb2971f9-bb02-4c16-9542-d77ac944d293"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:16.588424 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-204cee84-01bc-4665-81aa-40408b3aa5d5 req-cc625de4-2a01-47d5-94c0-a2a460af1951 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.589150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-204cee84-01bc-4665-81aa-40408b3aa5d5 req-cc625de4-2a01-47d5-94c0-a2a460af1951 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.633221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-204cee84-01bc-4665-81aa-40408b3aa5d5 req-cc625de4-2a01-47d5-94c0-a2a460af1951 service nova] Creating event network-vif-plugged:cb2971f9-bb02-4c16-9542-d77ac944d293 for instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 on hv-cinder-82635 Jun 14 18:00:16.642588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-204cee84-01bc-4665-81aa-40408b3aa5d5 req-cc625de4-2a01-47d5-94c0-a2a460af1951 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128690 Jun 14 18:00:16.647523 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 120/238] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:16.757821 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:16.792623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-23939d56-5e5e-42c5-a14c-b552371adf61 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.522854 Jun 14 18:00:16.796714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 119/239] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:16 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:16.838704 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:16.845350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:16.852232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.852682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.868232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.869126 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.919116 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:16.920272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:16.942175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.948490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:16.948850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:16.949475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:17.084302 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:17.096393 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9daa870b-0022-4bd4-880d-c18c0293c302 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1299 microversion: 2.1 time: 0.181696 Jun 14 18:00:17.096993 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 120/240] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:16 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:17.326752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:17.327776 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:17.341493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:17.369410 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:17.373698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:17.375002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:17.379611 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:17.388943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-13c42d35-4b36-4d37-ac98-081868ba5a3f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.555192 Jun 14 18:00:17.395666 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 121/241] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:16 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:17.543251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:17.545349 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:17.585905 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:17.587731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:17.589458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:17.590657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:17.737405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:17.748352 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-587d2d85-614f-47ca-9f08-86ac72fce900 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.455495 Jun 14 18:00:17.761879 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 121/242] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:17 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:17.815685 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:17.816957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:17.831184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:17.832551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:17.833869 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:17.834490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.212957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:18.241792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6cc32015-a58e-46d2-b6ea-0c8f6d47d50b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.429326 Jun 14 18:00:18.243745 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 122/243] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:17 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:18.267523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:18.267523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:18.290841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:18.292170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.302021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:18.302021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.338600 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:18.364739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:18.367255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:18.369493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-200e261b-453b-4c05-b601-6a89e8a33230 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.855340 Jun 14 18:00:18.386462 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 122/244] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:17 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:18.423365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:18.424500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:18.436922 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:18.440775 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.444966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:18.444966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.509580 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:18.549132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-26b349e0-d96e-475f-818a-8bfef9285d9a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1299 microversion: 2.1 time: 0.300230 Jun 14 18:00:18.570210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 123/245] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:18 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1299 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:18.779449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:18.779449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:18.782724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:18.793289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:18.793925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.794840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:18.798885 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:18.860744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=10 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:18.865264 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:18.874871 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f1a84d79-3430-4ecc-8b63-e52dff82101b tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.456689 Jun 14 18:00:18.880581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 123/246] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:18 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:19.074145 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:19.086819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:19.113012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b35ed394-6086-4965-bde2-3041a0701afe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.345690 Jun 14 18:00:19.122157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 124/247] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:18 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:19.265288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:19.266436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:19.284017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:19.286861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:19.288391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:19.330510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:19.413987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:19.415946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:19.481267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:19.481267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:19.481267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:19.481267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:19.866381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:19.880138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:19.882896 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:19.884734 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9ae6055d-6bb3-4b00-9f03-0df801cd216c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.498513 Jun 14 18:00:19.887889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 125/248] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:19 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:19.892466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:19.893419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:19.915464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:19.916312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:19.917404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:19.918122 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.019741 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=6 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:20.132861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:20.175901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-31d19879-ba6b-4e57-ab5c-e700111ac3b9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1319 microversion: 2.1 time: 0.917643 Jun 14 18:00:20.191782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 124/249] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:19 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1319 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:20.224998 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:20.226164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:20.257547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.258328 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.284434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.284434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.335968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:20.371524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e86db36b-a968-4204-9ae3-c94f0f5e73ca tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.484110 Jun 14 18:00:20.397761 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 126/250] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:19 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:20.423756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-32b20531-e24e-4733-a82c-1f3b26b12c32 req-30fca4f2-7ad3-4d5d-a454-46f5c1c167cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "name": "network-vif-plugged", "status": "completed", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:20.470571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-32b20531-e24e-4733-a82c-1f3b26b12c32 req-30fca4f2-7ad3-4d5d-a454-46f5c1c167cb service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.474150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-32b20531-e24e-4733-a82c-1f3b26b12c32 req-30fca4f2-7ad3-4d5d-a454-46f5c1c167cb service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.528193 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-32b20531-e24e-4733-a82c-1f3b26b12c32 req-30fca4f2-7ad3-4d5d-a454-46f5c1c167cb service nova] Creating event network-vif-plugged:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 18:00:20.551901 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-32b20531-e24e-4733-a82c-1f3b26b12c32 req-30fca4f2-7ad3-4d5d-a454-46f5c1c167cb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151361 Jun 14 18:00:20.553464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 127/251] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:20.580375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:20.580375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:20.591226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.592209 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.593651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.594977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.921184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:20.930474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fb8db3d4-2103-464c-9243-dfefda19505a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.735561 Jun 14 18:00:20.931081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 125/252] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:20 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:20.940798 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:20.941478 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:20.964849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.965324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.967690 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:20.968189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:20.992037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:21.019640 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1770c224-ef71-47a1-9494-161ef8736341 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.463028 Jun 14 18:00:21.020485 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 128/253] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:20 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:21.242678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:21.246367 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:21.262485 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:21.263748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:21.268172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:21.269794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:21.572540 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:21.586970 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:21.588680 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:21.596996 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-acf52ee9-91ab-4e4e-b4b4-72e14b119173 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.663970 Jun 14 18:00:21.612520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 126/254] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:20 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:21.635141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:21.636379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:21.644667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:21.645425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:21.646588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:21.647423 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:21.699380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:21.732136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0279c846-605a-4445-b5c9-bbd3e5d767c6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1508 microversion: 2.1 time: 0.517340 Jun 14 18:00:21.749100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 129/255] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:21 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:21.968654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:21.968969 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:21.970687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:21.977731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:21.990992 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-92db55b6-b762-49d0-835b-d1895c0a4e29 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.376645 Jun 14 18:00:21.991551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 127/256] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:21 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:22.012531 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.015170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:22.017625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.018707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:22.057579 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:22.059859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:22.076441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.080237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:22.081977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.086513 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:22.406177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:22.433111 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f20ddfe7-deec-48c1-a161-6e293c8c61f5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.474264 Jun 14 18:00:22.435891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:22.453211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-469ecf25-bc6f-49ca-9897-5bcc32bc8aac tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.407434 Jun 14 18:00:22.455369 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 128/257] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:22 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:22.464683 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 130/258] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:21 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:22.481601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-73a5c449-1e16-4d33-aa60-fa94c0664bb9 req-a3191331-0013-4160-aa98-d5c05f7a44da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2", "tag": "2c0fc3b7-0d5f-4866-8a2c-702a71a3e053"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:22.494513 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-73a5c449-1e16-4d33-aa60-fa94c0664bb9 req-a3191331-0013-4160-aa98-d5c05f7a44da service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.495269 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-73a5c449-1e16-4d33-aa60-fa94c0664bb9 req-a3191331-0013-4160-aa98-d5c05f7a44da service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:22.522359 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-73a5c449-1e16-4d33-aa60-fa94c0664bb9 req-a3191331-0013-4160-aa98-d5c05f7a44da service nova] Creating event network-changed:2c0fc3b7-0d5f-4866-8a2c-702a71a3e053 for instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 on hv-cinder-82635 Jun 14 18:00:22.531355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-73a5c449-1e16-4d33-aa60-fa94c0664bb9 req-a3191331-0013-4160-aa98-d5c05f7a44da service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053762 Jun 14 18:00:22.533458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 129/259] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:22.620604 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:22.621963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:22.643619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.644438 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:22.645266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:22.645742 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.024754 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:23.026234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:23.036951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:23.037846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.038121 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:23.040673 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:23.041360 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.058567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:23.064666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:23.067514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e701cd44-eda0-4ee9-9e6d-82ccb6862c64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.450868 Jun 14 18:00:23.069871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 131/260] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:22 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:23.467481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:23.469721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:23.481509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:23.482304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.483949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:23.484711 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.650891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:23.668036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-460b5144-c600-4ed4-90f0-3245d6328b64 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.650102 Jun 14 18:00:23.669443 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 130/261] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:23 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:23.676508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:23.677231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:23.683994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:23.695786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.698567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:23.700261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:23.750235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:23.776957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5962919a-4282-4c5f-8925-456eef88c31e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.315317 Jun 14 18:00:23.778010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 132/262] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:23 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:23.967879 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:23.990878 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-aa5afd02-cff2-45c7-bd9f-2c58c93782e3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.319905 Jun 14 18:00:23.991515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 131/263] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:23 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:24.089659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:24.091269 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:24.100381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:24.101592 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:24.102907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:24.103683 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:24.297928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:24.311638 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:24.314950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:24.317125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-83a3c2ec-1dde-4853-a49e-14f87bf18036 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.232195 Jun 14 18:00:24.319842 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 133/264] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:24 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:24.697385 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:24.698806 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:24.712570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:24.715700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:24.717033 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:24.718771 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:24.801167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:24.802280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:24.817751 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:24.818908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:24.822272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:24.823149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:25.025861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:25.038924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-eef39855-3afb-4f35-bd40-3dfcbb969a9d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.345546 Jun 14 18:00:25.039888 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 132/265] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:24 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:25.044755 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:25.045645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:25.052751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:25.053674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:25.054594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:25.055249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:25.237830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:25.249332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-24d10919-1e2c-42d0-80c2-5efe7053cfbf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.208256 Jun 14 18:00:25.261052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 133/266] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:25 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:25.263671 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:25.276423 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8b898f94-b434-4e79-8a43-0074491bde9a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.481589 Jun 14 18:00:25.277635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 134/267] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:24 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:25.340772 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:25.341815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:25.349220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:25.349976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:25.351010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:25.351564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:25.574608 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:25.588511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:25.590516 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:25.591905 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8e7c2d09-9fd9-44c6-a8d4-d314dbca3763 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.257095 Jun 14 18:00:25.592863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 134/268] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:25 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:26.061784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:26.063157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:26.072795 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.073759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.074975 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.075555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.269040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:26.270900 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:26.290365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.290901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.294241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.294913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.537242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:26.553563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-929c6137-0ab3-4732-8e41-a0b14d46281e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.288904 Jun 14 18:00:26.580889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 135/269] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:26 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:26.600780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:26.601876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:26.623898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.624657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.626567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.627840 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.638595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:26.673891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:26.691691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fdcba84f-42a4-4219-b8d3-e68dfdc0dd98 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.634636 Jun 14 18:00:26.694244 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 135/270] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:26 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:26.727049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:26.729091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:26.740741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.741782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:26.743065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:26.744079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:27.017075 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:27.038237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-dca9ea79-9960-40cf-8dd6-3ee9eda216af tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.453971 Jun 14 18:00:27.039632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 136/271] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:26 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:27.142716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:27.160397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:27.164231 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:27.167203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3e9e1279-391a-4e4b-97c9-17d1500fb4e9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.471044 Jun 14 18:00:27.168778 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 136/272] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:26 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:27.636927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:27.637812 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:27.654154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:27.658749 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:27.661097 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:27.671435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:27.726691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:27.727619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:27.740909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:27.743873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:27.743873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:27.744234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:27.978234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:27.989068 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-06b3462d-7e3a-4549-9905-72ab174e8365 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.359789 Jun 14 18:00:27.995386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 137/273] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:27 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:28.065669 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:28.070077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:28.070954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:28.080691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:28.081013 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:28.081927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:28.082404 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:28.083694 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2fa86e98-7c5f-46a3-a71f-f198f65cf289 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.360778 Jun 14 18:00:28.085724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 137/274] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:27 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:28.200922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:28.201613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:28.209223 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:28.209736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:28.210591 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:28.211095 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:28.258897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:28.268927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-38353e7a-bfc0-4eb9-ae43-f923e7f79bcf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.205992 Jun 14 18:00:28.270045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 138/275] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:28 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:28.444566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:28.454715 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:28.456590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:28.457979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-233723aa-9d36-47ed-9070-3488ce0d8721 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.263211 Jun 14 18:00:28.458819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 138/276] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:28 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:29.008805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:29.009692 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:29.028098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.028867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.029853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.030677 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.116528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:29.117454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:29.148678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.150443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.152406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.153795 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.274370 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:29.291514 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-89ccc89c-912f-4fe6-b86e-19481dc89faf tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.286299 Jun 14 18:00:29.293312 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 139/277] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:29 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:29.303329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:29.313572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:29.339812 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.340633 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.343519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.355849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.431199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:29.446570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-62d41130-8be3-4f8d-b2a2-bb2965d0297f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.337317 Jun 14 18:00:29.457888 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 139/278] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:29 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:29.479018 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:29.480184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:29.488469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.489582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.490659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:29.491397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:29.771110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:29.784569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:29.786317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:29.789632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ab64c99e-53e3-4ae3-9134-04c569f9e2be tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.314223 Jun 14 18:00:29.801467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 140/279] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:29 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:29.850593 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:29.880223 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9e4212a8-c3bf-490e-b615-322eaf4775e8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.584341 Jun 14 18:00:29.884903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 140/280] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:29 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:30.315718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:30.316632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:30.332732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.353687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:30.353687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.353687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:30.470931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:30.475706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:30.508110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.510959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:30.512257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.517218 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:30.673999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:30.689856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-934ad119-01c4-47c2-9c6b-4a026a90ea24 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.381717 Jun 14 18:00:30.691261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 141/281] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:30 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:30.701660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-78ae1690-9dee-47b0-95ae-d7d6745b47fd req-89a3c45b-5881-46cc-8af6-7c179e2438b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2", "name": "network-vif-plugged", "status": "completed", "tag": "2c0fc3b7-0d5f-4866-8a2c-702a71a3e053"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:30.729076 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-78ae1690-9dee-47b0-95ae-d7d6745b47fd req-89a3c45b-5881-46cc-8af6-7c179e2438b0 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.729924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-78ae1690-9dee-47b0-95ae-d7d6745b47fd req-89a3c45b-5881-46cc-8af6-7c179e2438b0 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:30.739922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:30.755935 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-78ae1690-9dee-47b0-95ae-d7d6745b47fd req-89a3c45b-5881-46cc-8af6-7c179e2438b0 service nova] Creating event network-vif-plugged:2c0fc3b7-0d5f-4866-8a2c-702a71a3e053 for instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 on hv-cinder-82635 Jun 14 18:00:30.768659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-78ae1690-9dee-47b0-95ae-d7d6745b47fd req-89a3c45b-5881-46cc-8af6-7c179e2438b0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074041 Jun 14 18:00:30.770778 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 142/282] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:30.882365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:30.883159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:30.904842 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.905331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:30.916489 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:30.916690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:31.084416 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:31.116792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6f7b3587-62f5-4ed7-a52c-21b5ea82d599 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.652789 Jun 14 18:00:31.120801 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 141/283] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:30 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:31.155830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:31.157081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:31.177455 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:31.181658 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:31.181658 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:31.181658 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:31.358693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:31.381662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:31.385712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:31.389238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-971695f1-7c40-4be6-b588-7b74d22cc6ca tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.565759 Jun 14 18:00:31.391644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 143/284] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:30 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:31.633197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:31.650099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c887df44-edf2-441a-8123-b2eceb1eea09 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.526113 Jun 14 18:00:31.651152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 142/285] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:31 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:31.722405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:31.723929 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:31.743190 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:31.744201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:31.745847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:31.747077 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.100607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:32.119194 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2881032f-f58c-488a-aab4-3707bf3bd829 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.405089 Jun 14 18:00:32.136779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 144/286] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:31 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:32.147849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:32.149109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:32.163241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:32.164204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.165649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:32.166536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.416098 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:32.416959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:32.429910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:32.430561 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.431398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:32.431832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.434976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:32.463695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-18962006-cf38-4d83-a2d0-1692f293927f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.323573 Jun 14 18:00:32.475668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 143/287] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:32 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:32.675815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:32.676457 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:32.677413 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:32.692347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:32.693346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.694728 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:32.695579 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:32.709989 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:32.713636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:32.716453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-459e4282-0419-46aa-beeb-1949ef5fa6f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.305082 Jun 14 18:00:32.727334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 145/288] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:32 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:32.966597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:32.978179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f72ff2f5-bba5-4b21-8e81-f1410d35b3e7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.311837 Jun 14 18:00:32.979581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 144/289] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:32 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:33.148701 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:33.149504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:33.157058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:33.157622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:33.158772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:33.159418 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:33.452639 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:33.499839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b946648f-00dc-4202-a842-b00312b154a8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.356508 Jun 14 18:00:33.511429 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 146/290] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:33 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:33.511758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:33.511758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:33.518010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:33.520079 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:33.522672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:33.524301 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:33.751292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:33.752445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:33.761947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:33.762853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:33.764078 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:33.764835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:33.805288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:33.823194 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e6cf72e7-3413-47e1-9f87-a4a52c73bc85 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1367 microversion: 2.1 time: 0.328273 Jun 14 18:00:33.825456 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 145/291] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:33 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:33.939985 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:33.950490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:33.953135 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:33.955974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a09a3d16-5f20-4322-9c83-345056fcc791 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.218450 Jun 14 18:00:33.956747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 147/292] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:33 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:34.002697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:34.003212 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:34.009690 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:34.010141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:34.010925 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:34.011382 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:34.177363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:34.186354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a05139da-6907-4ab6-b91f-4a05e4714ca9 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.189129 Jun 14 18:00:34.186949 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:33 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:34.550786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:34.551670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:34.559327 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:34.560120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:34.561132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:34.561733 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:34.826595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:34.845079 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:34.846939 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:34.847973 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-72184ede-ac4a-479a-966a-adc19caed8a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.300731 Jun 14 18:00:34.850424 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 148/294] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:34 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:34.855476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:34.860904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:34.860904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:34.860904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:34.993704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:34.999459 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:35.020199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.021060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.022949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.024082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.073393 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:35.093937 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d99adfd2-28af-4751-b018-0aeded6d3bef tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1558 microversion: 2.1 time: 0.255244 Jun 14 18:00:35.099471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 147/295] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:34 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1558 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:35.167616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:35.168723 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:35.196311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.205648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.207120 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.207850 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.266291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:35.307684 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:35.313502 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:35.317695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-636de275-0046-4c0f-96bb-054f946fc247 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.338387 Jun 14 18:00:35.320351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 149/296] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:34 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:35.327902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:35.331666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:35.345691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.347475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.350447 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.352722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.390469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e4ddba7f-3b35-4210-b878-4b544c63b58e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.251098 Jun 14 18:00:35.399032 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 148/297] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 18:00:35 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:35.746960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-38840118", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-922967960", "security_groups": [{"name": "tempest-secgroup-smoke-277531782"}], "networks": [{"uuid": "0f9a4f9d-66bc-41eb-b450-3b21b5b66eaa"}], "block_device_mapping_v2": [{"uuid": "9bf8f7f0-25cf-40e9-b2f3-6f71d2efd6f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:35.763181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:35.781043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-67f01dce-c47c-4dd1-b83c-ebb7735ee57e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.458294 Jun 14 18:00:35.782422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 150/298] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:35 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:35.873932 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:35.874562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:35.883886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.884918 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.885990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:35.886623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:35.959222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] validate_networks() for [('0f9a4f9d-66bc-41eb-b450-3b21b5b66eaa', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:00:36.260822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:36.271595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4b87bc91-779c-4940-a89a-89ea79642d35 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.402783 Jun 14 18:00:36.272466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 151/299] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:35 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:36.338300 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:36.339060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:36.345535 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:36.345974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:36.346746 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:36.348511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:36.522901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:00:36.523581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:00:36.524800 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:00:36.525594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:00:36.526458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:00:36.552049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:36.552649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:36.554202 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:36.556077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:36.595143 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Getting quotas for project add35554d0514dc59890c61894593313. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:00:36.599844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:36.605066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Getting quotas for user e6b1c08311384aa39ad01a8378c9a056 and project add35554d0514dc59890c61894593313. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:00:36.706800 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:00:36.713809 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9bf8f7f0-25cf-40e9-b2f3-6f71d2efd6f8',volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:00:36.959254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:36.975947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:36.978486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:36.980493 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4dd1ae17-de24-466f-a27c-704762ab5fe0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1740 microversion: 2.20 time: 0.646046 Jun 14 18:00:36.981442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 152/300] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:36 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1740 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:37.003697 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:37.005461 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:37.013994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:37.014675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:37.015679 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:37.016840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:37.235829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:37.245297 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-473b464d-f758-476d-a007-9aa97cfc332e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.262114 Jun 14 18:00:37.245888 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 153/301] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:36 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:37.295403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:37.300316 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-af4143dc-951a-4746-b734-19ecb53b481f tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.559389 Jun 14 18:00:37.300316 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 149/302] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:00:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:00:37.302488 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:37.309429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8b392e08-f22c-4749-bd8c-d034aa7266e5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:37.312415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8b392e08-f22c-4749-bd8c-d034aa7266e5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:37.316641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:37.317826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:37.323607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:37.325234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:37.445272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8b392e08-f22c-4749-bd8c-d034aa7266e5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:37.453217 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8b392e08-f22c-4749-bd8c-d034aa7266e5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1086 microversion: 2.1 time: 0.148824 Jun 14 18:00:37.454726 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 150/303] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:37 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1086 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:37.652182 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:37.669841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-79423992-66eb-4170-b565-24d436bddedd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.383413 Jun 14 18:00:37.685199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 154/304] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:37 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:37.752318 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-a267fe1c-1a8f-4404-a37d-212961fcf6e8 req-10fce686-266f-42f8-8bcb-117cbd12b335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2", "tag": "2c0fc3b7-0d5f-4866-8a2c-702a71a3e053"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:37.766087 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a267fe1c-1a8f-4404-a37d-212961fcf6e8 req-10fce686-266f-42f8-8bcb-117cbd12b335 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:37.767132 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a267fe1c-1a8f-4404-a37d-212961fcf6e8 req-10fce686-266f-42f8-8bcb-117cbd12b335 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:37.791456 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-a267fe1c-1a8f-4404-a37d-212961fcf6e8 req-10fce686-266f-42f8-8bcb-117cbd12b335 service nova] Creating event network-changed:2c0fc3b7-0d5f-4866-8a2c-702a71a3e053 for instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 on hv-cinder-82635 Jun 14 18:00:37.798216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-a267fe1c-1a8f-4404-a37d-212961fcf6e8 req-10fce686-266f-42f8-8bcb-117cbd12b335 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049081 Jun 14 18:00:37.799500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 151/305] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:38.005169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:38.007732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:38.032794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:38.032794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:38.032794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:38.032794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:38.270738 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:38.271476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:38.284730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:38.285178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:38.289116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:38.290872 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:38.303460 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:38.328066 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:38.332261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:38.333736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d1133205-114a-4858-9898-5edb25c180df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1722 microversion: 2.20 time: 0.336677 Jun 14 18:00:38.336083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 155/306] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:37 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1722 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:38.472157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cdf91d62-f035-4c4d-b01c-13a4e1437839 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:38.472801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cdf91d62-f035-4c4d-b01c-13a4e1437839 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:38.584625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cdf91d62-f035-4c4d-b01c-13a4e1437839 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:38.595754 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cdf91d62-f035-4c4d-b01c-13a4e1437839 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1086 microversion: 2.1 time: 0.128190 Jun 14 18:00:38.597608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 156/307] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:38 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1086 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:38.706252 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:38.707445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:38.728079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:38.728546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:38.729345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:38.729609 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:38.730304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:38.755620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8fe86ada-001d-4063-9570-c7d0705fc827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.490786 Jun 14 18:00:38.756534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 152/308] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:38 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:38.911433 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:38.924476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5cc9799f-79e3-41eb-88ab-3d70ca280e2b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.226279 Jun 14 18:00:38.925346 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 157/309] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:38 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:39.375742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:39.376826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:39.386187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.386746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.387806 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.388250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.572722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:39.582492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:39.584112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:39.585329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e9b6c155-f23d-4fd3-b3af-730b43e2f617 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1722 microversion: 2.20 time: 0.214426 Jun 14 18:00:39.585897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 153/310] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:39 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:39.623065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:39.630736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:39.631603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.632069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.632944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.633383 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.711772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:39.724612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6eb95ac6-d5f3-4f06-b6a5-69c037cafe13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1136 microversion: 2.1 time: 0.106542 Jun 14 18:00:39.731539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 158/311] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:39 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1136 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:39.775960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:39.776938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:39.785632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.786149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.787004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.787572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.948069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:39.949118 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:39.960613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.960981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.961805 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:39.962254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:39.988743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:40.013833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b3b6126a-47d0-4642-8ecb-e3855f8351a1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.235430 Jun 14 18:00:40.013833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 154/312] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:39 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:40.127135 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:40.143419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9928e1a9-ff10-4fa8-a121-0764bc14ce1a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.202768 Jun 14 18:00:40.144378 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 159/313] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:39 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:40.292111 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-20593efb-71bb-49a7-aba7-e6e55e33bab6 req-50b65465-f555-4deb-a1fd-a5658a4d52d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "name": "network-vif-unplugged", "status": "completed", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:40.301616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-20593efb-71bb-49a7-aba7-e6e55e33bab6 req-50b65465-f555-4deb-a1fd-a5658a4d52d2 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:40.302298 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-20593efb-71bb-49a7-aba7-e6e55e33bab6 req-50b65465-f555-4deb-a1fd-a5658a4d52d2 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:40.318916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-20593efb-71bb-49a7-aba7-e6e55e33bab6 req-50b65465-f555-4deb-a1fd-a5658a4d52d2 service nova] Creating event network-vif-unplugged:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 18:00:40.325182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-20593efb-71bb-49a7-aba7-e6e55e33bab6 req-50b65465-f555-4deb-a1fd-a5658a4d52d2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036813 Jun 14 18:00:40.326264 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 155/314] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:40.605418 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:40.612889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:40.625159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:40.627225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:40.628262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:40.628883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:40.658331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:40.746894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:40.748364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:40.759814 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:40.760426 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:40.762064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:40.762613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:40.768580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:40.815608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:40.820969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:40.822616 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:40.823882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-78ff297a-8ff1-410d-ad47-98a97c8c2864 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1722 microversion: 2.20 time: 0.222565 Jun 14 18:00:40.824648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 160/315] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:40 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:41.039128 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:41.040274 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:41.050250 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:41.050966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:41.051997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:41.052752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:41.102459 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:41.112129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ae1bb688-86a0-4533-b9c7-f0ba10d87cc6 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1136 microversion: 2.1 time: 0.370554 Jun 14 18:00:41.119372 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 156/316] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:40 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1136 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:41.169927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:41.171099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:41.179994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:41.180927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:41.182297 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:41.182843 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:41.241536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:41.258907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a2bf94c5-4a86-47b9-acf2-f24124582b36 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.227703 Jun 14 18:00:41.260189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 161/317] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:41 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:41.394604 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:41.403262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f9d17d66-e45d-4b48-a74c-f78a7776b3aa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.240183 Jun 14 18:00:41.403888 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 157/318] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:41 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:41.851006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:41.851006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:41.877318 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:41.878080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:41.879526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:41.880267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.137241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:42.138434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:42.140720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:42.148619 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:42.149318 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.150468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:42.151060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.164065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:42.166963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:42.168815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ed1db7a4-25a7-49b3-867f-ac22acf2f53b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1722 microversion: 2.20 time: 0.329056 Jun 14 18:00:42.170080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 162/319] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:41 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1722 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:42.261286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:42.261286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fc89f0a2-56c0-4323-a764-c9dc8be749ba tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1128 microversion: 2.1 time: 0.114019 Jun 14 18:00:42.261286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 158/320] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:42 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1128 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:42.283552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:42.284179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:42.290906 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:42.291366 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.292137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:42.292564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.433786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:42.440353 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:42.446715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:42.448125 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.449528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:42.450287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:42.462826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:42.473073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fe27dcd7-3b57-4986-9c07-bc2450d0b727 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.197763 Jun 14 18:00:42.473665 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 163/321] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:42 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:42.650604 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:42.659927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c4da9e65-a7c6-4294-affa-8058f79245f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1523 microversion: 2.1 time: 0.232455 Jun 14 18:00:42.660565 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 159/322] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:42 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:43.202945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:43.204355 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:43.211376 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.211833 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.212620 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.213257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.276728 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:43.279335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:43.294490 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.296619 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.298878 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.299843 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.438463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:43.447163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:43.448519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:43.449069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:43.450358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-38e011c5-ed0d-40a7-ab25-b4dc1d996b86 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1725 microversion: 2.20 time: 0.252088 Jun 14 18:00:43.451029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 164/323] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:43 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:43.464933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f4c968e7-2979-4405-b847-b4885d09f3c9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1184 microversion: 2.1 time: 0.191884 Jun 14 18:00:43.466508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 160/324] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:43 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1184 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:43.480680 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3fdbbc-5f2a-4675-b632-cc78cf75a680"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:43.482851 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:43.492966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.493589 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.494696 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.495141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:43.495479 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.496173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:43.505569 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.506018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.506907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.507382 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.765376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:43.774548 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8af4e605-a5fd-4c02-935e-cea45278b257 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.286451 Jun 14 18:00:43.775156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 161/325] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:43 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:43.779965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:43.780573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:43.787897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.799591 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.799591 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:43.799591 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:43.977119 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:43.986164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-00576f07-e5a5-4889-b790-41770e7bf5ee tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1503 microversion: 2.1 time: 0.209796 Jun 14 18:00:43.989060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 162/326] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:43 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:44.004818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:44.005442 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:44.012203 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:44.012664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:44.013496 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:44.013935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:44.241086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:44.253815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7d7a3944-a8fe-4c55-9cd0-b8f553798883 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1517 microversion: 2.1 time: 0.253472 Jun 14 18:00:44.255570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 163/327] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:43 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:44.492682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:44.497126 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:44.518605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:44.519178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:44.520712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:44.521200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:44.627978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:44.666452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c1396264-c35e-4eaf-b732-0eecf2b61b85 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1192 microversion: 2.1 time: 0.181238 Jun 14 18:00:44.667531 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 164/328] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:44 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1192 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:44.797537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:44.799176 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:44.806762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:44.807525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:44.808904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:44.811520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:45.040583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-751f1671-2f89-4cc6-8111-d1e8ebb31d32 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.566036 Jun 14 18:00:45.043085 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 165/329] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jun 14 18:00:43 2022] POST /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments => generated 188 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:00:45.081287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:45.092933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b82b0e61-f73a-4334-93d4-75d4bde41677 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.300062 Jun 14 18:00:45.107338 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 165/330] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:44 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:45.299613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:45.301106 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:45.315220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:45.316448 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:45.318214 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:45.319271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:45.693181 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:45.694632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:45.712094 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:45.714950 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:45.716902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:45.717671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:45.818316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b549ada6-cbd1-4cb3-b082-ec7882837461 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/action" status: 202 len: 0 microversion: 2.20 time: 0.526491 Jun 14 18:00:45.822659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 166/331] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 14 18:00:45 2022] POST /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:00:45.836945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:45.843815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:45.855710 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:45.857717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:45.859548 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:45.860364 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:46.159960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:46.185586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:46.208765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:46.209415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:46.226097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3f315e26-f781-4bb4-a294-2663f65855b1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1751 microversion: 2.20 time: 0.383875 Jun 14 18:00:46.227177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 167/332] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:45 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1751 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:46.249892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:46.252249 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:46.266659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:46.267945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:46.269511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:46.270757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:46.272504 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-464db136-6c3d-44a6-9dcc-c397dae2ad32 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1269 microversion: 2.1 time: 0.581724 Jun 14 18:00:46.273916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 166/333] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:45 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1269 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:46.560849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:46.569510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:46.582873 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:46.602403 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:46.602887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:46.607713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:46.608078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:46.663606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:46.683965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b61097b9-6082-4008-a58d-a9154dd24b0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.442405 Jun 14 18:00:46.685525 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 168/334] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:46 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:46.691345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'flavor' on Instance uuid 59e01abb-08b2-4506-8fae-b466262f45e4 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:00:47.105204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8a61413a-f53a-4ee3-ba54-b4aff4e425f4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/action" status: 200 len: 32 microversion: 2.1 time: 0.552802 Jun 14 18:00:47.106759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 167/335] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:00:46 2022] POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/action => generated 32 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 14 18:00:47.122992 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:47.127165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:47.142859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.143728 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.145518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.146407 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.274880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:47.276146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:47.302972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.303496 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.304931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.308082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.450678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=8 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:47.517968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:47.520662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1d8bf627-c0cf-4171-bec5-bd4cfdf2b069 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.403882 Jun 14 18:00:47.532973 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 169/336] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:47 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:47.539015 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:47.540270 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:47.548949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.549801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.551173 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.552152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.788464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:47.803961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-894e63ec-6f77-4fbc-8a1b-c1084b5953a7 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.268003 Jun 14 18:00:47.805769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 170/337] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:47 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:47.815112 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:47.816443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:47.827134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.827878 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.829626 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:47.830376 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:47.998026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:48.014804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:48.018325 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:48.022185 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1479764c-07bd-41d2-9d90-e6d67524acfb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1751 microversion: 2.20 time: 0.765744 Jun 14 18:00:48.023941 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 168/338] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:47 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1751 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:48.033820 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a757e1e2-85f6-4be4-9064-874f98812179", "device": "/dev/sdb"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:48.037393 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:48.050826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.051911 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.053668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.054420 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.105414 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:48.118365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0ea6cc95-5179-43e7-b381-decf11fbc666 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1701 microversion: 2.1 time: 0.310866 Jun 14 18:00:48.118965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 171/339] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:47 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1701 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:48.136935 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4fdd6b59-347d-4d21-b96f-e464ce2c08a6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:48.144248 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4fdd6b59-347d-4d21-b96f-e464ce2c08a6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.144486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4fdd6b59-347d-4d21-b96f-e464ce2c08a6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.226063 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4fdd6b59-347d-4d21-b96f-e464ce2c08a6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Going to try to start instance {{(pid=125161) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 14 18:00:48.258595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:48.449934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4fdd6b59-347d-4d21-b96f-e464ce2c08a6 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action" status: 202 len: 0 microversion: 2.1 time: 0.317672 Jun 14 18:00:48.455621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 172/340] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:00:48 2022] POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:00:48.462684 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-19f82d15-149b-422a-8717-2498c70185a2 req-a12abe9f-d36c-41f5-8919-50f70d235cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:48.473312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-19f82d15-149b-422a-8717-2498c70185a2 req-a12abe9f-d36c-41f5-8919-50f70d235cdb service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.474034 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-19f82d15-149b-422a-8717-2498c70185a2 req-a12abe9f-d36c-41f5-8919-50f70d235cdb service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.491701 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-19f82d15-149b-422a-8717-2498c70185a2 req-a12abe9f-d36c-41f5-8919-50f70d235cdb service nova] Creating event network-changed:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:00:48.512889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-19f82d15-149b-422a-8717-2498c70185a2 req-a12abe9f-d36c-41f5-8919-50f70d235cdb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046069 Jun 14 18:00:48.512889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 173/341] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:48.521750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:48.522467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:48.529842 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.530546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.532807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.533501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.595370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:48.798562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:48.811033 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9b2a9bbe-60b5-4d42-855b-a5fcf45b59dc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1710 microversion: 2.1 time: 0.295905 Jun 14 18:00:48.811033 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 174/342] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:48 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1710 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:48.815451 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:48.816395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:48.824820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.825609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:48.836055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:48.836582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:49.009891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:49.310922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:49.319800 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-96b8f724-fbe6-4daf-82f6-b2fbec00bce2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.509131 Jun 14 18:00:49.320400 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 175/343] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:48 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:49.329827 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:49.330895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:49.337762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:49.338201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:49.338991 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:49.339464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:49.374511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-be267559-fd40-4577-8a67-e227658f659a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "POST /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.347858 Jun 14 18:00:49.376408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 169/344] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:00:48 2022] POST /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664/os-volume_attachments => generated 194 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:49.403722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:49.404427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:49.414473 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:49.415011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:49.415757 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:49.416189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:49.576145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:49.599345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:49.601303 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:49.602866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6d3884d0-30e9-4720-bd89-efbc7da11a0c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1751 microversion: 2.20 time: 0.223111 Jun 14 18:00:49.603471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 170/345] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:49 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:49.636635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:49.647486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d43fab46-b9fb-4d70-9d96-a9c63bdb996e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.325869 Jun 14 18:00:49.652150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 176/346] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:49 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:49.833924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:49.834585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:49.847165 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:49.847666 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:49.851020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:49.851396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.134772 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:50.144762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-93f5a91c-3ebf-4d9c-9eee-dd1d3da82ec3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1710 microversion: 2.1 time: 0.315138 Jun 14 18:00:50.145616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:49 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1710 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:50.340799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:50.341439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:50.350145 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:50.350793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.351752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:50.352354 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.550550 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:50.564330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8d7272a1-3c4b-4faf-8f6d-b0727d0a27b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.227493 Jun 14 18:00:50.565420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 177/348] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:50 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:50.624732 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:50.625452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:50.636434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:50.636928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.638004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:50.638460 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.674030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:50.675516 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:50.679837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:50.683790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:50.684550 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.686480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:50.687376 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:50.834248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:50.844819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:50.847207 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:50.848502 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d0cfc28b-1a12-4e2c-be6b-06f7d879ee6a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.230082 Jun 14 18:00:50.860975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 172/349] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:50 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:50.894260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:50.905862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8ee70ef4-0785-4586-9b3c-ab3726fe2dbf tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.238347 Jun 14 18:00:50.907191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 178/350] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:50 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:51.166263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:51.167254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:51.177375 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.177981 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.178779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.179215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.370829 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:51.381225 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d178c173-2cf1-4a6a-8b42-9651636f0dda tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1710 microversion: 2.1 time: 0.219740 Jun 14 18:00:51.381815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 173/351] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:51 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:51.590353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:51.590998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:51.598842 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.599289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.600100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.600532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.798955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:51.810472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4e7a649a-62ae-4303-b771-fb4be65d27fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.224172 Jun 14 18:00:51.811115 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 179/352] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:51 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:51.868575 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:51.869183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:51.877703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.878312 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.879436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.880014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.928051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:51.929033 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:51.939351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.939988 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:51.941040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:51.941623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:52.089344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:52.103507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:52.105223 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:52.106432 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-24474e96-af10-4c5c-87bc-3b7c338af364 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.242117 Jun 14 18:00:52.107220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 174/353] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:51 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:52.126883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:52.147918 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0b5c1081-d1c5-47e5-b60c-cdd61a1789c2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.216436 Jun 14 18:00:52.147918 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 180/354] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:51 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:52.398834 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:52.399501 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:52.406121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:52.406577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:52.407481 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:52.407866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:52.574370 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:52.583633 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1cf6c175-ab2b-4ffd-b4ba-aae9db2e0bdb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1714 microversion: 2.1 time: 0.188761 Jun 14 18:00:52.584232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 175/355] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:52 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1714 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:52.830166 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:52.830780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:52.837840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:52.838420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:52.839208 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:52.839678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:52.986722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:53.000397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ef2f5565-6ab2-4a90-99d1-a789c14a65bd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.174328 Jun 14 18:00:53.001291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 181/356] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:52 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:53.125784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:53.126994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:53.133985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:53.134434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:53.135201 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:53.135657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:53.166111 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:53.166722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:53.173789 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:53.174232 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:53.175177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:53.175660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:53.331795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:53.341106 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:53.342654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:53.343908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4f9f0089-2f09-46b7-a23b-7f0219768de0 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.222395 Jun 14 18:00:53.344528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 176/357] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:53 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:53.349769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1585286089", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "networks": [{"uuid": "c469c60e-7a30-4b06-a30d-1c1e2a3b8f97"}]}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:53.365255 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:53.374404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-094554d1-3cd1-485f-a2ab-8bd3c852fdd0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.212092 Jun 14 18:00:53.374992 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 182/358] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:53 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:53.411408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] validate_networks() for [('c469c60e-7a30-4b06-a30d-1c1e2a3b8f97', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:00:53.808201 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:00:53.808617 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:00:53.809085 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:00:53.809488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:00:53.809984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:00:53.822189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:53.822622 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:53.823444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:53.823875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:53.843325 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Getting quotas for project 3412103661474550b6c9926648e13ab6. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:00:53.849037 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Getting quotas for user 4fdef75ae06e47a5a2632acd314d3de6 and project 3412103661474550b6c9926648e13ab6. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:00:53.861594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:00:53.863935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:00:54.008069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ab0560ae-2ea6-4d49-95f1-8b513adc8ade tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.662033 Jun 14 18:00:54.008729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 177/359] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:00:54.019349 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7bc87c43-4124-4574-afcd-708d8222d2ae tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:54.019977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7bc87c43-4124-4574-afcd-708d8222d2ae tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:54.022679 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:54.023891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:54.033343 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:54.033801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:54.035219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:54.035702 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:54.107365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7bc87c43-4124-4574-afcd-708d8222d2ae tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:54.115705 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7bc87c43-4124-4574-afcd-708d8222d2ae tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1214 microversion: 2.1 time: 0.100876 Jun 14 18:00:54.116553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 178/360] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:54 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:54.228376 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:54.242209 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-adb53b8e-b397-4ec1-9e72-4bddefd58aa7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.227114 Jun 14 18:00:54.243261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 183/361] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:54 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:54.362632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:54.363083 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:54.371109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:54.371585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:54.372374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:54.372869 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:54.394797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:54.395883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:54.403183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:54.403889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:54.404722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:54.405142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:54.585691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:54.590432 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:54.600508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:54.602018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:54.602363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-877c0ae7-2b6a-4b70-b177-5895dce1df45 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.213261 Jun 14 18:00:54.603199 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e14a08a0-4324-4557-8639-b88a9ddaebe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.245071 Jun 14 18:00:54.603714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 184/362] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:54 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:54.614860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 179/363] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:54 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:55.134051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1d8989ac-7498-4e7d-8185-094444f080d2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:55.134606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1d8989ac-7498-4e7d-8185-094444f080d2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:55.191946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1d8989ac-7498-4e7d-8185-094444f080d2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:55.199099 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1d8989ac-7498-4e7d-8185-094444f080d2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1214 microversion: 2.1 time: 0.068946 Jun 14 18:00:55.199716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 185/364] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:55 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:55.266515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:55.267132 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:55.273614 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:55.274069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:55.274847 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:55.275279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:55.429153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:55.437164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a7b8af07-97e6-4b08-90e3-7845ded2e38f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.174580 Jun 14 18:00:55.437803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 180/365] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:55 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:55.622366 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:55.622965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:55.629084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:55.629715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:55.630196 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:55.630647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:55.631462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:55.631915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:55.636123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:55.636582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:55.638014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:55.638014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:55.827368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:55.836144 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-10c431ed-68d3-421f-8a4e-c51a6a12d399 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.211314 Jun 14 18:00:55.836853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 181/366] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:55 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:55.850134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:55.860650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:55.862566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:55.863817 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-59fe4a65-8426-4b25-8413-46fec7e48cba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.245423 Jun 14 18:00:55.864483 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 186/367] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:55 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:56.218876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:56.220324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:56.227121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.227605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.228437 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.228844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.300648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:56.308635 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9f247150-8a85-4969-b8d8-941349562a67 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1210 microversion: 2.1 time: 0.093614 Jun 14 18:00:56.309744 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 182/368] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:56 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:56.458388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:56.459252 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:56.466645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.467253 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.468069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.475630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.639421 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:56.648288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e3954f6a-796f-4aa9-a255-c6976246fda0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.195498 Jun 14 18:00:56.648883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 187/369] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:56 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:56.854035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:56.854645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:56.862865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.863356 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.864202 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.864644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.885251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:56.885863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:56.893437 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.893887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:56.894673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:56.895384 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:57.047177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:57.074238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-84a120a4-49c0-479b-a3b5-dc5f91d68395 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.222064 Jun 14 18:00:57.076231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 183/370] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:56 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:57.104143 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:57.117834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:57.119450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:57.120679 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6b9a6b64-e301-45f2-a406-cc463293bfe1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.239435 Jun 14 18:00:57.121540 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 188/371] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:56 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:57.327241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:57.327802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:57.335333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:57.335789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:57.336585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:57.337022 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:57.409162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:57.423491 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-76cf9310-5861-4d24-8abf-123e0140aa51 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1266 microversion: 2.1 time: 0.099358 Jun 14 18:00:57.427046 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 184/372] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:57 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:57.670162 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:57.671337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:57.684760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:57.685495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:57.686925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:57.687637 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:57.905576 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:57.930085 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5b1d32e6-9f7d-4030-8817-7dcef24739a6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.266811 Jun 14 18:00:57.931758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 189/373] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:57 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:58.099417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:58.101472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:58.113169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.113888 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.115247 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.116226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.143859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:58.144648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:58.161492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.162182 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.165599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.166181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.349507 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:58.353893 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:58.359271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:58.361700 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:58.362980 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1028f758-7380-4b2d-839b-371d54153463 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.226274 Jun 14 18:00:58.363801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 190/374] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:58 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:00:58.441959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:58.442756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:58.455450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.456274 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.457886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.458687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.519602 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:58.534444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2b6082de-641c-4483-806a-568dbe0d4974 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.442992 Jun 14 18:00:58.536124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 185/375] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:58 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:00:58.604887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:58.614857 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7e130289-9d88-4629-b385-e7e60158ef90 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1272 microversion: 2.1 time: 0.177394 Jun 14 18:00:58.615567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 191/376] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:58 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:58.634805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-11c662a3-7c12-467a-a160-ee29b049fec7 req-48c95e63-9307-43ca-8d98-3ec16c464865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "name": "network-vif-plugged", "status": "completed", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:00:58.638880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:00:58.645863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-11c662a3-7c12-467a-a160-ee29b049fec7 req-48c95e63-9307-43ca-8d98-3ec16c464865 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.646296 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-11c662a3-7c12-467a-a160-ee29b049fec7 req-48c95e63-9307-43ca-8d98-3ec16c464865 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.659409 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-11c662a3-7c12-467a-a160-ee29b049fec7 req-48c95e63-9307-43ca-8d98-3ec16c464865 service nova] Creating event network-vif-plugged:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:00:58.664944 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-11c662a3-7c12-467a-a160-ee29b049fec7 req-48c95e63-9307-43ca-8d98-3ec16c464865 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036876 Jun 14 18:00:58.665618 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 186/377] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:00:58.954217 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:58.956438 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:58.991356 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.995598 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:58.996807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:58.997373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.306102 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:59.318505 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d12e5e99-7b40-437f-9ec4-df9b2cd463d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.371909 Jun 14 18:00:59.320795 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 192/378] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:58 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:59.383932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:59.384628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:59.392499 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:59.392963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.394880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:59.394880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.561185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:59.573095 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:59.580312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:59.580787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.581676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:59.582111 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.734470 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:59.747224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:59.756956 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:59.760219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:59.761280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fc1dbffa-087b-4f12-94fc-c419dd22bc76 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.204509 Jun 14 18:00:59.762324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 193/379] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:59 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:00:59.762703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b79a7b62-c088-4441-8415-2a710fa97521 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.383592 Jun 14 18:00:59.763958 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 187/380] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:00:59 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:00:59.769314 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:00:59.770041 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:00:59.778251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:59.778695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.779522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:00:59.779955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:00:59.959804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:00:59.967634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7aba592b-71a5-4f88-9def-688af24ab875 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.202718 Jun 14 18:00:59.969176 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 194/381] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:00:59 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:00.350183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:00.351556 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:00.363098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.364030 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.365108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.365714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.393740 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:00.537153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:00.545150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8df8105b-2650-4f7a-a530-894b69be566c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.202396 Jun 14 18:01:00.545762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 188/382] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:00 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:00.783107 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:00.783954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:00.789577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:00.790391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:00.791027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.791518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.792481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.792721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.798258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.798710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.799641 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.800113 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.933061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:00.942237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:00.943757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:00.944933 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6ca270c7-83e2-42f7-b722-9e8e4d72567c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.166695 Jun 14 18:01:00.945494 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 195/383] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:00 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:00.963574 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:00.972175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-14dcb434-120e-4b4d-8ad9-b102c5f9cabd tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.188059 Jun 14 18:01:00.972760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 189/384] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:00 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:00.985857 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:00.986562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:00.992887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.993339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:00.994714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:00.994714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:01.147887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:01.155843 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4d745d02-18af-4f20-80ad-a7408e881524 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.174289 Jun 14 18:01:01.156436 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 196/385] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:00 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:01.562621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:01.564155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:01.571195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:01.571694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:01.572493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:01.572931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:01.719878 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:01.728014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0bee820f-d393-41cd-ae97-bbffe6ce8780 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.169230 Jun 14 18:01:01.728613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 190/386] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:01 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:01.963871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:01.964491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:01.972462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:01.972926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:01.973727 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:01.974166 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:01.993962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:01.995053 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:02.005594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:02.006316 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:02.007642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:02.008355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:02.152707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:02.164475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:02.166031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:02.167288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d605d1da-f12f-4e98-b369-d46cce724af8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1753 microversion: 2.20 time: 0.207757 Jun 14 18:01:02.169606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 197/387] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:01 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:02.177188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:02.178586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:02.190368 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:02.191163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:02.192722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:02.192859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:02.193470 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:02.201100 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8c8646bb-b628-4d4b-a288-b1a2e5b4b23c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.214227 Jun 14 18:01:02.201701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 191/388] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:01 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:02.412753 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:02.429426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-71019a15-5bc1-47b7-9eea-78459c3ddd3a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.258239 Jun 14 18:01:02.430492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:02 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:02.747427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:02.748272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:02.756936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:02.757387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:02.758263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:02.758942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.002243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:03.012512 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2bb9857f-9776-425a-b3ab-31f7de3ce312 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.269506 Jun 14 18:01:03.013202 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 192/390] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:02 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:03.190689 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:03.192496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:03.201707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.202320 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.203359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.204530 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.220219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:03.221231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:03.227999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.228556 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.229806 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.229936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.465826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:03.475039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a3246fda-99d4-40cf-9428-1666b0890686 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1257 microversion: 2.1 time: 0.259497 Jun 14 18:01:03.475671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 193/391] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:03 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1257 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:03.480597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-bd1e2bc6-8332-41c9-9259-f5b93bf3f8aa req-c9ab0642-4894-4411-92f6-56f8d8942f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d6039e6-24eb-49c5-903a-24dca8d10840", "tag": "ce833eb3-5cc0-4ce3-8afc-e9f8280df452"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:03.496531 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-bd1e2bc6-8332-41c9-9259-f5b93bf3f8aa req-c9ab0642-4894-4411-92f6-56f8d8942f2e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.496971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-bd1e2bc6-8332-41c9-9259-f5b93bf3f8aa req-c9ab0642-4894-4411-92f6-56f8d8942f2e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.511895 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-bd1e2bc6-8332-41c9-9259-f5b93bf3f8aa req-c9ab0642-4894-4411-92f6-56f8d8942f2e service nova] Creating event network-changed:ce833eb3-5cc0-4ce3-8afc-e9f8280df452 for instance 1d6039e6-24eb-49c5-903a-24dca8d10840 on hv-cinder-82635 Jun 14 18:01:03.521668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-bd1e2bc6-8332-41c9-9259-f5b93bf3f8aa req-c9ab0642-4894-4411-92f6-56f8d8942f2e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044684 Jun 14 18:01:03.535428 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 194/392] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:01:03.547106 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:03.548140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:03.556029 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.556486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.557677 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:03.559260 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:03.628202 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:03.637815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:03.639359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:03.640542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-eb506b5d-9819-4da3-a36a-50b0760b0571 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.457783 Jun 14 18:01:03.641690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 199/393] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:03 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:03.729778 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:03.738231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-68478bf5-911f-42a0-9083-7ffea349bcaa tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.198748 Jun 14 18:01:03.738826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 195/394] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:03 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:04.039487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:04.332007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:04.332007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.332007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.332007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.334554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.334554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:04.334554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a37ef6d1-a1d1-4287-af2b-feb9dd8161be tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.286035 Jun 14 18:01:04.334554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 200/395] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:04 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:04.500072 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:04.501008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:04.503284 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:04.504024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=8 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:04.509541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.510003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.510974 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.511451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.659983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:04.660593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:04.666962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.667454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.668229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.668664 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.680280 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:04.690052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6e42d559-aa06-4d5f-8804-990b5d60b5e4 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1440 microversion: 2.1 time: 0.193790 Jun 14 18:01:04.695432 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 196/396] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:04 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1440 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:04.710689 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:04.711542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:04.718445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.718988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.720333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.720920 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.827354 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:04.838787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:04.843199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:04.845692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fddc158e-7e13-4073-ba1c-6dda7a8ab69c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.189387 Jun 14 18:01:04.846963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 201/397] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:04 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:04.855480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:04.856487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:04.865286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.865735 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.866797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:04.867238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:04.898489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:04.909720 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-78b91b9c-20e9-4306-9bf4-f08e07ed60b9 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1440 microversion: 2.1 time: 0.204324 Jun 14 18:01:04.910788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 197/398] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:04 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1440 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:05.056275 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:05.065420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-08a13519-a489-4f74-b30a-f94aab66cc46 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.216712 Jun 14 18:01:05.066333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 202/399] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:04 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:05.340992 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:05.341710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:05.349334 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:05.349876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:05.351063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:05.353123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:05.503262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:05.512481 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-99228ada-7a22-42e3-b34e-a569da2a20d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.175531 Jun 14 18:01:05.513540 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 198/400] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:05 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:05.877222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:05.877821 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:05.879848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:05.885718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:05.886194 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:05.886958 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:05.887434 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:06.083118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:06.083845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:06.095589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:06.096412 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:06.097829 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:06.098635 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:06.161896 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:06.174285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:06.175969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:06.177716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ee8ca031-853a-4f22-91be-204f11ae06bd tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.304824 Jun 14 18:01:06.189639 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 203/401] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:05 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:06.264000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:06.274365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bd5d6d52-04b4-46c5-99b3-a4d8df171857 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.195530 Jun 14 18:01:06.278698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 199/402] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:06 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:06.534997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:06.535608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:06.542178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:06.542631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:06.543437 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:06.543874 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:06.906808 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:06.915443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-81a8c656-3d0c-4b5c-bedd-0469ee8d38a3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.387938 Jun 14 18:01:06.916043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 204/403] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:06 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:07.197253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:07.197860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:07.206065 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.206519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:07.207317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.207753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:07.297108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:07.298063 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:07.304055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.304513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:07.305577 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.305890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:07.392711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:07.408497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:07.411695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:07.414429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2a75a11f-7117-4f5d-a234-b04d7d2abaab tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.221094 Jun 14 18:01:07.416141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 200/404] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:07 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:07.446939 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-11bd1920-e770-41f4-a4c7-670255164f3b req-cc1e7554-6478-4d2e-a046-c9590614d4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:07.459266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-11bd1920-e770-41f4-a4c7-670255164f3b req-cc1e7554-6478-4d2e-a046-c9590614d4d6 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.459743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-11bd1920-e770-41f4-a4c7-670255164f3b req-cc1e7554-6478-4d2e-a046-c9590614d4d6 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:07.472474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-11bd1920-e770-41f4-a4c7-670255164f3b req-cc1e7554-6478-4d2e-a046-c9590614d4d6 service nova] Creating event network-changed:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:01:07.477592 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-11bd1920-e770-41f4-a4c7-670255164f3b req-cc1e7554-6478-4d2e-a046-c9590614d4d6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036535 Jun 14 18:01:07.478355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 201/405] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:07.515715 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:07.524353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-39dcc964-eff0-4af6-9fe8-31614b0db236 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.235909 Jun 14 18:01:07.525081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 205/406] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:07 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:07.934199 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:07.935024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:07.946464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.946972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:07.947953 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:07.948439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:08.100783 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:08.109085 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d57ef6a1-0453-403e-8043-a4e49be23d00 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.179314 Jun 14 18:01:08.110162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 202/407] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:07 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:08.435262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:08.435974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:08.444073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:08.444720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:08.445706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:08.446256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:08.544405 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:08.545460 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:08.554329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:08.556004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:08.557074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:08.557846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:08.595057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:08.605586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:08.607090 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:08.608278 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-06721b62-f798-4929-9d09-986370132fd5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.177235 Jun 14 18:01:08.608844 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 206/408] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:08 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:08.713892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:08.724164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9fc310c2-7a6c-4177-8001-a5e442e43ab5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.182928 Jun 14 18:01:08.724164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 203/409] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:08 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:09.127725 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:09.131706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:09.136535 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:09.136997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:09.137789 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:09.138228 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:09.161029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:09.307870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:09.317189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8bbcca87-4d90-49ca-95ea-3aa9f877c03a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.194026 Jun 14 18:01:09.317783 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 207/410] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:09 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:09.627389 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:09.634547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:09.635475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:09.635967 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:09.636754 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:09.637184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:09.740676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:09.749249 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:09.749791 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:09.751185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:09.752112 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:09.752563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:09.796112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:09.812363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:09.815477 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:09.817821 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-83ff287b-7275-4d92-81dd-2c367c1f0440 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.195114 Jun 14 18:01:09.818902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 204/411] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:09 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:09.916726 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:09.925399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8c60ca20-df34-4bd6-867e-d936408bcd27 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.189264 Jun 14 18:01:09.925977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 208/412] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:09 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:10.336175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:10.336820 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:10.343039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:10.343527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:10.344899 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:10.345341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:10.482384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:10.491332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-21780dd3-8cbf-4512-be1c-88b82e873187 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.158937 Jun 14 18:01:10.491919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 205/413] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:10 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:10.845654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:10.846189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:10.852658 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:10.853101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:10.853852 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:10.854280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:10.944167 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:10.944857 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:10.951726 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:10.952257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:10.953126 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:10.953647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:10.974098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:10.996289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:11.006027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:11.007683 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:11.008937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-65fb19dd-aa60-4886-bf49-07c80e1c71fb tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.167802 Jun 14 18:01:11.009518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 209/414] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:10 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:11.098211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:11.106081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e11d733e-f4cd-4cce-b9bb-9d7cbb407dff tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.167591 Jun 14 18:01:11.106670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 206/415] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:10 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:11.509132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:11.510035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:11.516898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:11.517393 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:11.518370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:11.518845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:11.667825 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:11.676838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-94caf0b5-2d22-47c5-8be1-aded859c96cc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.171489 Jun 14 18:01:11.677417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 210/416] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:11 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:12.028314 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:12.029003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:12.036636 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:12.037089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:12.037904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:12.038346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:12.123582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:12.124199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:12.131928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:12.132375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:12.133157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:12.133592 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:12.180789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:12.190788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:12.192512 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:12.193745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8ac0e12b-44c5-470a-b40c-496c8c6d2736 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.169557 Jun 14 18:01:12.194317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 207/417] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:12 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:12.282924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:12.293019 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-746df75b-471a-40f4-86d9-e2c917a28c70 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.173326 Jun 14 18:01:12.293610 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 211/418] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:12 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:12.693939 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:12.694553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:12.701032 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:12.701486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:12.702314 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:12.702763 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:12.859406 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:12.871918 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-824c60f2-29f0-477c-ad26-da0351a78901 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.181359 Jun 14 18:01:12.873020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 208/419] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:12 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:13.212774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:13.213403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:13.221263 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:13.221785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:13.222570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:13.223011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:13.310753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:13.311387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:13.318455 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:13.324040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:13.324040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:13.324040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:13.395914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:13.406267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:13.408481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:13.409695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b6f33454-fdaa-46ce-9fbb-4677b45341ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.200893 Jun 14 18:01:13.410262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 212/420] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:13 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:13.473945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:13.481673 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0e91ec10-16cc-447f-bfdb-e29f399e2a0f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.175113 Jun 14 18:01:13.482243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 209/421] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:13 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:13.892318 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:13.893260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:13.900780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:13.901435 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:13.902421 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:13.902975 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:14.057935 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:14.074483 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5f0d183f-93d9-49af-b397-400f4cb6375d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.185774 Jun 14 18:01:14.076610 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 213/422] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:13 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:14.431282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:14.432832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:14.441994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:14.442923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:14.444169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:14.444910 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:14.508887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:14.508887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:14.515031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:14.517206 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:14.518446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:14.520187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:14.917547 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:14.928376 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cbaba1b1-7749-4266-b8b9-71792edb225f tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.433555 Jun 14 18:01:14.928965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 214/423] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:14 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:14.930466 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:14.941008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:14.942654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:14.943892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a9860bb4-e381-404a-ad28-b9df3c1f9a11 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.518609 Jun 14 18:01:14.944657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 210/424] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:14 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:15.098713 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:15.099851 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:15.113125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:15.113125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:15.113125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:15.113125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:15.405686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:15.429083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-682b41c7-5f9d-4549-bce1-4ff4f8d0dc54 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.337677 Jun 14 18:01:15.448004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 215/425] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:15 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:15.945589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:15.946200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:15.953051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:15.953679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:15.961221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:15.961221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:15.963225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:15.964091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:15.972011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:15.972424 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:15.973333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:15.973899 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:16.185216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:16.201988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8d7a4ac8-ad30-453b-91cc-a2a66cb1a48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.253721 Jun 14 18:01:16.207843 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 211/426] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:15 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:16.226074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:16.237419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:16.239266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:16.240677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-85dfebef-3ff0-4250-a7fe-1f824a3379c8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.281989 Jun 14 18:01:16.251957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 216/427] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:15 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:16.457299 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:16.457928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:16.465486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:16.471141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:16.472234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:16.472662 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:16.636142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:16.645458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b80b1a48-858f-4902-93a3-cf44b0ea1a16 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1503 microversion: 2.1 time: 0.193853 Jun 14 18:01:16.646686 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 212/428] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:16 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:16.663890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b6fde27-5d38-4957-b869-90c0ecbdc011"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:16.665266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:16.672155 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:16.673475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:16.674044 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:16.674560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:16.723602 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] HTTP exception thrown: Cannot 'attach_volume' instance 59e01abb-08b2-4506-8fae-b466262f45e4 while it is in vm_state rescued Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Request method failure captured: Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/os-volume_attachments HTTP/1.1 Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 74 Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMyHLiL1wgrsiN0IALwIB4DiL_rl1UCmi-mg2SERiVU3VMVMy7zNiUbUrXqjqZ3WRs7mhLCSO8GKIZC3cA0QzEfx0dCwlnpTIafOAa8zSgTD4QtSNe95msCXz_IoL1RbsqCbvKVme-IuW41_QR75o-uPfVO4F9pp7HThPvEm3xEdHqc Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:01:16.727109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c8e2494e0744c778b32f979005ec7ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 7f214333671e4878bf613c26ceb1381a Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {"volumeAttachment": {"volumeId": "1b6fde27-5d38-4957-b869-90c0ecbdc011"}} Jun 14 18:01:16.730254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Cannot 'attach_volume' instance 59e01abb-08b2-4506-8fae-b466262f45e4 while it is in vm_state rescued Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'server_id': '59e01abb-08b2-4506-8fae-b466262f45e4', 'body': {'volumeAttachment': {'volumeId': '1b6fde27-5d38-4957-b869-90c0ecbdc011'}}} Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:01:16.731970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 59e01abb-08b2-4506-8fae-b466262f45e4 while it is in vm_state rescued Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:16.733668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 59e01abb-08b2-4506-8fae-b466262f45e4 while it is in vm_state rescued Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Returning 409 to user: Cannot 'attach_volume' instance 59e01abb-08b2-4506-8fae-b466262f45e4 while it is in vm_state rescued {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0e809a11-b8d5-455a-9a0d-ff562da53634 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.077901 Jun 14 18:01:16.739147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 217/429] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:01:16 2022] POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/os-volume_attachments => generated 152 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 14 18:01:16.748321 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:16.748862 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:16.756187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:16.756648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:16.757449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:16.757916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.025703 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-7a7bf371-75bc-4c0a-98f4-2be77d0012ca req-60a459f4-59bd-4caf-9691-f9490a0b7b7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6039e6-24eb-49c5-903a-24dca8d10840", "name": "network-vif-plugged", "status": "completed", "tag": "ce833eb3-5cc0-4ce3-8afc-e9f8280df452"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:17.043395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-69e55a9d-3c96-4c58-b9a1-a332bb2f2ffd tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/action" status: 202 len: 0 microversion: 2.1 time: 0.297617 Jun 14 18:01:17.043395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 213/430] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:01:16 2022] POST /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:01:17.044463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-7a7bf371-75bc-4c0a-98f4-2be77d0012ca req-60a459f4-59bd-4caf-9691-f9490a0b7b7f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.044926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-7a7bf371-75bc-4c0a-98f4-2be77d0012ca req-60a459f4-59bd-4caf-9691-f9490a0b7b7f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.052420 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:17.053113 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:17.065907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.072772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-7a7bf371-75bc-4c0a-98f4-2be77d0012ca req-60a459f4-59bd-4caf-9691-f9490a0b7b7f service nova] Creating event network-vif-plugged:ce833eb3-5cc0-4ce3-8afc-e9f8280df452 for instance 1d6039e6-24eb-49c5-903a-24dca8d10840 on hv-cinder-82635 Jun 14 18:01:17.076335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.076542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-7a7bf371-75bc-4c0a-98f4-2be77d0012ca req-60a459f4-59bd-4caf-9691-f9490a0b7b7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054971 Jun 14 18:01:17.077099 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 218/431] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:01:17.078019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.078664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.226204 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:17.226998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:17.236640 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.236927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.237646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.238129 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.249204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:17.264434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4f2275c8-f32a-4775-a27b-877b43d9b44a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.216841 Jun 14 18:01:17.265247 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 214/432] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:17 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:17.273715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:17.275180 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:17.299614 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.300314 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.301790 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.302244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.436059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:17.448405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-54a8b541-adb9-408a-8be6-2ba47afec7fd tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.226738 Jun 14 18:01:17.458320 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 219/433] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:17 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:17.463983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:17.464492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:17.479340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.479340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.479340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:17.479340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:17.532822 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:17.544222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:17.547997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:17.550368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-082ce563-732f-4102-8d75-e3626038162b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.280837 Jun 14 18:01:17.551226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 215/434] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:17 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:17.636439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lazy-loading 'services' on Instance uuid dfba6f52-c4c7-410c-8d59-4fd9e65c3664 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:17.897546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b6d87901-4cc3-4b43-bbd7-783ea3d631de tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664/os-volume_attachments/a757e1e2-85f6-4be4-9064-874f98812179" status: 202 len: 0 microversion: 2.1 time: 0.437800 Jun 14 18:01:17.898138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 220/435] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:01:17 2022] DELETE /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664/os-volume_attachments/a757e1e2-85f6-4be4-9064-874f98812179 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:01:18.283078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:18.283825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:18.291226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:18.291719 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:18.292528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:18.292975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:18.470555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:18.471754 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:18.479969 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:18.484224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:18.490021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:18.490021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:18.490021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:18.490348 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fac2e924-fcc0-411c-ad0a-825ead3155c5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.210698 Jun 14 18:01:18.491058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 216/436] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:18 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:18.576173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:18.576533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:18.583879 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:18.584315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:18.585081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:18.585515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:18.686444 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:18.698131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9f9c8268-3534-47b0-940a-01f58708d8e5 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.235620 Jun 14 18:01:18.698962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 221/437] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:18 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:18.790687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:18.801882 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:18.803464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:18.804687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-350874f2-de5e-4182-99b1-c357515e559b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.232709 Jun 14 18:01:18.805429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 217/438] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:18 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:19.509924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:19.510898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:19.519419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:19.520017 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:19.521138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:19.521586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:19.673166 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:19.681566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-569b0461-7561-4307-8322-8c845ffb166a tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.176309 Jun 14 18:01:19.692295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 222/439] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:19 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:19.715829 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:19.716670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:19.724257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:19.724257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:19.724257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:19.724257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:19.825058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:19.825830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:19.845194 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:19.845865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:19.846963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:19.847562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:19.901880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:19.910468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-53ab85e9-a896-496e-adc8-77fa05ff84f0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.198444 Jun 14 18:01:19.911232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 218/440] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:19 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:20.043954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:20.057035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:20.059012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:20.062310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d220c3d6-c807-4183-9590-1de1ba0c540a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.240492 Jun 14 18:01:20.062579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 223/441] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:19 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:20.700322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:20.700932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:20.708231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:20.708710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:20.709455 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:20.709891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:20.876543 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:20.884572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cda77542-ee0c-4b92-8c79-07f7114cbc19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.188166 Jun 14 18:01:20.885170 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 219/442] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:20 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:20.937016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:20.940876 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:20.954968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:20.956338 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:20.957963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:20.958911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:20.984046 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:21.088888 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:21.090507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:21.108445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:21.109670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:21.112639 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:21.113388 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:21.158419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:21.173248 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-55c72057-ace6-4877-bbb2-f62e693f77a7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.245315 Jun 14 18:01:21.180180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 224/443] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:20 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:21.342997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:21.353698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:21.355233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:21.356441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4f94e0ee-93b2-4610-ac9e-a98e57724da6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.276361 Jun 14 18:01:21.359441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 220/444] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:21 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:21.904203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:21.904832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:21.907438 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=95 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:21.912893 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:21.913353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:21.914150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:21.914593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:22.082069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:22.089840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fff59784-b63d-4124-940c-c8d03d846b46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.189608 Jun 14 18:01:22.090419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 225/445] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:21 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:22.208226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:22.209779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:22.216884 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:22.217440 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:22.218320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:22.218826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:22.378447 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:22.379762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:22.389025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:22.393603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:22.394177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:22.395042 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:22.395608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:22.401898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5d4576fa-78d4-419c-8199-009aa24e2380 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.200906 Jun 14 18:01:22.402946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 221/446] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:22 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:22.554914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:22.566558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:22.569031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:22.570353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0093ac1c-9c8e-44a8-8710-5680355f2739 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.197604 Jun 14 18:01:22.571175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 226/447] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:22 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:23.108586 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:23.109329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:23.121704 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:23.122787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:23.125038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:23.126411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:23.135686 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:23.311186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:23.319529 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-61563f00-7e1f-4cff-8dd4-8d989962697f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.214919 Jun 14 18:01:23.320116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 222/448] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:23 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:23.425601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:23.426238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:23.433477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:23.433934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:23.434721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:23.435169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:23.578142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:23.586040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-eb001007-9d0a-4e5b-afb1-c048e7a3f6d7 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.165618 Jun 14 18:01:23.586770 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 227/449] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:23 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:23.590220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:23.590941 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:23.598175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:23.598630 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:23.599451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:23.599919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:23.760537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:23.770640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:23.772623 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:23.774069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7a55251c-306e-47d5-9692-c4b50031f756 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.187681 Jun 14 18:01:23.779821 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 223/450] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:23 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:24.342082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:24.343650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:24.350583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:24.351113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:24.352009 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:24.352603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:24.518330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:24.526438 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-34b3b86f-5274-4e77-a6ad-ec59dc79478f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.192143 Jun 14 18:01:24.527007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 228/451] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:24 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:24.610550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:24.610550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:24.617026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:24.617581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:24.618362 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:24.618800 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:24.764102 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:24.773146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cd1618c4-4ef1-4e08-9aa7-99609943e590 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.168545 Jun 14 18:01:24.773730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 224/452] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:24 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:24.794593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:24.795215 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:24.803179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:24.803669 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:24.804472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:24.804917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:24.957696 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:24.967124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:24.968728 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:24.970673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-83ace2cc-f1cb-4d56-822b-cf85b734978a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.179835 Jun 14 18:01:24.973750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 229/453] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:24 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:25.543952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:25.544554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:25.552129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:25.552592 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:25.553397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:25.553841 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:25.780843 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:25.792122 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:25.793267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:25.801046 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:25.801505 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:25.801922 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c719544f-fea5-4c14-8b7e-59c87ac0c4b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.260681 Jun 14 18:01:25.802405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:25.802846 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:25.803826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 225/454] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:25 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:25.968011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:25.978426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f2287ace-34d0-4387-adba-3c3412b26e92 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.190802 Jun 14 18:01:25.986991 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 230/455] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:25 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:25.992674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:25.996866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:25.999656 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:26.000108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:26.001125 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:26.001574 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:26.138145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:26.149151 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:26.150690 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:26.151894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8e14cb2e-2c0e-4780-aa1e-09fe9767ae13 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.166156 Jun 14 18:01:26.157262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 226/456] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:25 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:26.821616 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:26.822532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:26.828862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:26.829307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:26.830067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:26.830501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:26.989685 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:26.998316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3cf4a707-8d75-4dc0-a9e9-c29d88d9e2fe tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.181048 Jun 14 18:01:26.998905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 231/457] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:26 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:26.999339 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:26.999955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:27.008344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:27.008791 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:27.009559 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:27.009995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:27.161299 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:27.169731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cc5f8b5b-0ba0-4860-99f0-e2568907d48c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.175336 Jun 14 18:01:27.170566 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 227/458] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:26 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:27.170789 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:27.171520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:27.178724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:27.179262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:27.180136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:27.180666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:27.326814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:27.336130 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:27.341059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:27.341059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-188550ef-c53a-4fa1-a743-b3fa206b0cb5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.172098 Jun 14 18:01:27.341059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 232/459] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:27 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:28.020517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:28.021402 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:28.028080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:28.028539 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:28.029316 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:28.029751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:28.188767 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:28.189600 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:28.197763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:28.198256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:28.199046 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:28.199513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:28.235605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:28.256788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1400de39-b0af-4f20-834f-8832c6a08d82 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.228418 Jun 14 18:01:28.256788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 228/460] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:28 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:28.349882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:28.358596 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:28.359291 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:28.359547 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-29e985bf-1b43-4e18-84d0-7e18d20a5655 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.174947 Jun 14 18:01:28.360848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 233/461] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:28 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:28.371026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:28.371891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:28.373309 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:28.374101 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:28.540156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:28.550413 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:28.551974 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:28.553182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4624c769-e25a-4979-8743-f5cfab706699 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.198974 Jun 14 18:01:28.553764 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 229/462] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:28 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:29.262409 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:29.263166 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:29.270861 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:29.271610 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:29.272432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:29.272866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:29.390029 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:29.392777 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:29.401789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:29.408124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:29.408124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:29.408124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:29.600766 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:29.610216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6a659d70-63a6-43d8-b541-afeaabeb0419 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.351108 Jun 14 18:01:29.626480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 234/463] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:29 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:29.632652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:29.633594 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:29.639813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:29.643716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:29.643716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:29.643716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:29.712460 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:29.721954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-530e6bff-cede-48ba-a1f2-2e9d105867ef tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.336972 Jun 14 18:01:29.722857 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 230/464] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:29 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:29.807065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:29.819617 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:29.819741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:29.821342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7b85023e-7bbd-4178-92ea-79cadcf4a702 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.192935 Jun 14 18:01:29.822167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 235/465] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:29 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:30.629435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:30.630027 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:30.632450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=90 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:30.637424 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.637952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.638764 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.639530 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.738754 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:30.739401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:30.746432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.746885 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.747709 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.748401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.794807 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:30.802911 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1120a011-9124-498e-9e0e-21fd103d87da tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.178281 Jun 14 18:01:30.803530 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 231/466] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:30 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:30.845186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:30.845805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:30.853650 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.854233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.861664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.861664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.924936 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:30.932787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ac2236ff-22f4-4fb8-8266-b65ea484e264 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1314 microversion: 2.1 time: 0.198204 Jun 14 18:01:30.933369 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 236/467] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:30 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:30.938974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:30.939512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:30.945832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.946286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.947066 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:30.947542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:30.986088 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:01:31.033639 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:31.042496 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:31.044273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:31.049773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-dd3bf1e1-05c5-4534-a213-bbdb4dde57e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.205266 Jun 14 18:01:31.049773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 232/468] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:30 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:31.338429 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a30c4abc-738c-4fec-b4b9-db23242f7afb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "DELETE /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 204 len: 0 microversion: 2.1 time: 0.403429 Jun 14 18:01:31.339158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 237/469] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:01:30 2022] DELETE /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:01:31.349141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:31.349756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:31.356542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:31.356983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:31.357810 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:31.358252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:31.514911 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:31.524550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ab359452-19cf-4206-aaf3-58c700ace577 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.180055 Jun 14 18:01:31.525148 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 233/470] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:31 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:31.821826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:31.822501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:31.829304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:31.830335 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:31.831098 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:31.831590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:31.952972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:31.953564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:31.960669 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:31.961123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:31.961908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:31.962343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:31.980250 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:31.989507 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fefced30-14ad-4304-a1eb-3889022ede47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.171761 Jun 14 18:01:31.990089 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 238/471] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:31 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:32.064732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:32.065349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:32.071991 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:32.072557 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:32.073370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:32.073878 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:32.095220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:32.119598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:32.130419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-97de0e17-aa67-491c-8cc5-7cc29341649d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1498 microversion: 2.1 time: 0.181356 Jun 14 18:01:32.211153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 234/472] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:31 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1498 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:32.229219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:32.238252 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:32.239887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:32.241050 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2dc2001b-9919-45c3-82c6-15768bac36ce tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.180961 Jun 14 18:01:32.241607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 239/473] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:32 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:32.543692 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:32.544384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:32.552341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:32.552956 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:32.553765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:32.554208 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:32.703683 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:32.712803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ae00bc88-b241-4cbc-9618-349be08c7205 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.173181 Jun 14 18:01:32.713485 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 235/474] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:32 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:33.008495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:33.009366 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:33.019365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.019873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.020788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.021945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.190093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:33.201359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f62952a5-4e63-48e3-a8cb-c377669b3a20 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.196982 Jun 14 18:01:33.202356 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 240/475] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:33 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:33.261374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:33.265700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:33.270324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.271376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.272847 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.273706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.442039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:33.451028 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:33.453597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:33.455018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cfdc9a47-9602-4c19-a843-41cd12a73838 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.198704 Jun 14 18:01:33.455663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 236/476] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:33 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:33.695486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:33.696069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:33.707243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.707243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.707243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.707243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.737960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:33.738988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:33.746859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:01:33.749578 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.750317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.751936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:33.753851 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:33.916720 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:33.927635 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d2d1a3df-3622-4dad-bcbd-43e4b303c3d9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.197085 Jun 14 18:01:33.928435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 237/477] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:33 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:34.092373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7b8ba168-7bd9-43cf-ad3f-cfae40eb9662 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 204 len: 0 microversion: 2.1 time: 0.400887 Jun 14 18:01:34.093296 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 241/478] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:01:33 2022] DELETE /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:01:34.106047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.107145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.115773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.116298 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.117434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.117880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.226060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.226060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.235235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.236666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.238393 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.239260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.272712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:34.278035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:34.282976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ab892c0d-a09a-4159-80e8-44fbdf1dc607 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.184316 Jun 14 18:01:34.283674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 238/479] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:34 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:34.346177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.347647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.354128 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.354879 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.355747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.356199 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.383687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d086275e-cd2a-4795-9a9e-7f7153363b6e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/ips" status: 200 len: 150 microversion: 2.1 time: 0.042433 Jun 14 18:01:34.384310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 239/480] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 18:01:34 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:34.395215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d18715c6-5143-44d3-ae89-fcddbe347f3e"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:34.396745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.401608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:34.404223 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.404377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.405178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.405618 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.410827 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7398254a-462d-4e32-9c55-5335c5462822 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.192900 Jun 14 18:01:34.411606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 242/481] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:34 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:34.474239 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.474839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.481483 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.481870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.482645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.483081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.493087 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Invalid volume: volume d18715c6-5143-44d3-ae89-fcddbe347f3e is already attached to instances: 97278dbc-a791-43fb-b077-cd4f0a0bebf7 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: POST /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/os-volume_attachments HTTP/1.1 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 74 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:01:34.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {"volumeAttachment": {"volumeId": "d18715c6-5143-44d3-ae89-fcddbe347f3e"}} Jun 14 18:01:34.497954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Invalid volume: volume d18715c6-5143-44d3-ae89-fcddbe347f3e is already attached to instances: 97278dbc-a791-43fb-b077-cd4f0a0bebf7 Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'server_id': '5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2', 'body': {'volumeAttachment': {'volumeId': 'd18715c6-5143-44d3-ae89-fcddbe347f3e'}}} Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d18715c6-5143-44d3-ae89-fcddbe347f3e is already attached to instances: 97278dbc-a791-43fb-b077-cd4f0a0bebf7 Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:34.498904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d18715c6-5143-44d3-ae89-fcddbe347f3e is already attached to instances: 97278dbc-a791-43fb-b077-cd4f0a0bebf7 Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:34.500333 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d18715c6-5143-44d3-ae89-fcddbe347f3e is already attached to instances: 97278dbc-a791-43fb-b077-cd4f0a0bebf7 Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 400 to user: Invalid volume: volume d18715c6-5143-44d3-ae89-fcddbe347f3e is already attached to instances: 97278dbc-a791-43fb-b077-cd4f0a0bebf7 {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ae0337c0-1239-48ec-97ca-d19455309d0a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105493 Jun 14 18:01:34.502411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 240/482] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:01:34 2022] POST /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 14 18:01:34.510522 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.511151 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.519179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.519826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.520552 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.520961 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.547459 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:01:34.668491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:34.677806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:34.679579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:34.680731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-65769d17-c3fa-4fca-a99a-c29f10e48a76 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.211133 Jun 14 18:01:34.681278 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 243/483] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:34 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:34.904084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2a36db96-f1f6-4a8c-a0fb-d1680962972b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 204 len: 0 microversion: 2.1 time: 0.400324 Jun 14 18:01:34.905289 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 241/484] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:01:34 2022] DELETE /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:01:34.915952 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.917670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.923145 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.923726 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.924698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.925136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.951248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:34.952121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:34.961858 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.962683 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:34.964305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:34.965134 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.076567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.085815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1a14bfee-ceee-4024-8f1f-867a9adef20c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.173601 Jun 14 18:01:35.086394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 244/485] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:34 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:35.135518 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.143335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9edebdd9-a034-4539-99a3-7dd9f682d5e3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.196516 Jun 14 18:01:35.143918 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 242/486] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:34 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:35.301212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:35.301777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:35.308291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:35.308747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.309537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:35.309976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.429954 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:35.430784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:35.437294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:35.438225 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.440136 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:35.440584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.453221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.462360 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0bf12177-2a24-4833-baa4-d624ad1d0095 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.165465 Jun 14 18:01:35.463509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 245/487] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:35 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:35.596065 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.604397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-de0a78d6-c2a5-4609-ae91-54e7d4f2ac40 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1511 microversion: 2.1 time: 0.179109 Jun 14 18:01:35.604988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 243/488] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:35 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:35.699927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:35.700548 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:35.706959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:35.707461 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.708247 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:35.708721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:35.882520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.893389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.895357 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:35.897503 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e4bd1f49-d3e6-48c0-99ef-275563b57961 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.201817 Jun 14 18:01:35.898240 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 246/489] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:35 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:36.113253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:36.113879 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:36.120074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.122127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.122127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.122127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.162538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:36.163199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:36.169968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.170447 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.171235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.171698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.274209 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:36.292751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7d1a59d6-8e9c-480a-9cd7-29707d50da0c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.183634 Jun 14 18:01:36.293784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 244/490] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:36 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:36.371261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:36.379522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cea17b28-1b09-43c8-8b6f-4aa2c749e5d7 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.222072 Jun 14 18:01:36.380114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 247/491] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:36 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:36.478824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:36.479492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:36.487021 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.487558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.488483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.489031 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.627677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:36.628811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:36.639277 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.640108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.641489 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.642764 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.645086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:36.653415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-28dc6d5b-186e-49b6-a5a8-c06796b9b628 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.178761 Jun 14 18:01:36.654006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 245/492] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:36 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:36.814628 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:36.823115 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-afc66e65-15b6-4e6c-8b2b-9f6f18835466 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1517 microversion: 2.1 time: 0.203351 Jun 14 18:01:36.823732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 248/493] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:36 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1517 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:36.921774 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:36.922384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:36.930528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.930985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:36.931793 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:36.932263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.078653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:37.088613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:37.090331 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:37.091594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-57a17a8b-b172-4d67-8a5c-bfc068081c9c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.173786 Jun 14 18:01:37.092508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 246/494] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:36 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:37.316484 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:37.317070 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:37.324815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:37.325389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.326406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:37.326939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.403266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:37.404282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:37.412017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:37.412617 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.413776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:37.414369 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.505619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:37.514810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2be866fd-7855-44bb-9feb-51308ba9dbab tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.203968 Jun 14 18:01:37.515835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 249/495] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:37 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:37.622812 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:37.633071 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1b141abf-0580-434d-8ebf-5a471ed2bdc6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.233979 Jun 14 18:01:37.633858 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 247/496] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:37 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:37.676329 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:37.677492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:37.687961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:37.688775 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.690178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:37.690979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:37.858602 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:37.867786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8b60f3b1-87e7-4d83-8b08-60f6eb061315 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.199508 Jun 14 18:01:37.868272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 250/497] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:37 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:38.112360 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:38.112842 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:38.119759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.120213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.121006 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.121443 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.275246 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:38.285302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:38.286860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:38.288120 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7dfaa9c2-0a2a-4cd2-8f60-f251f85a0f44 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.180628 Jun 14 18:01:38.288703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 248/498] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:38 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:38.540136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:38.540872 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:38.548826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.549256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.550150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.550618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.587890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-73a134f0-6ec4-4907-a6f4-fbf95fe2c0af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'create', calling method: .version_select at 0x7fbafc151af0>, body: {"keypair": {"name": "tempest-keypair-1912862043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5ZIM5XarE7FdNe+C66ZvhhpJO0nQrFzrwPI84WMk07g7WXriwUzJ+yiicsxclQWZO80Cxrgi/kXbhkmo0go11PJMt/VJg4NCBrbJyFysbKm/ZLZlCgwWES+k5ocmfS6w=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:38.604786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-73a134f0-6ec4-4907-a6f4-fbf95fe2c0af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:01:38.609012 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-73a134f0-6ec4-4907-a6f4-fbf95fe2c0af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for user 7f214333671e4878bf613c26ceb1381a and project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:01:38.711445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:38.725716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-afd81045-67a8-4fe3-8ac4-8dd6dc99405b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.188903 Jun 14 18:01:38.726790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 251/499] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:38 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:38.737055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:38.741521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:38.742031 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-73a134f0-6ec4-4907-a6f4-fbf95fe2c0af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157805 Jun 14 18:01:38.743334 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 249/500] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:01:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:38.750318 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.751225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.753258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.754088 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.898484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:38.907440 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:38.915831 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.916804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.917685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:38.917965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:38.958521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:38.966354 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1889fd1f-418f-4d7d-9ac6-df91fbeb8f12 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.237656 Jun 14 18:01:38.967169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 252/501] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:38 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:39.011788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-0830d301-8733-43d6-8935-1e05c9511304 req-3cc5bb81-e5e2-4fd3-90d1-47b810c57d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfba6f52-c4c7-410c-8d59-4fd9e65c3664", "name": "network-vif-unplugged", "status": "completed", "tag": "cb2971f9-bb02-4c16-9542-d77ac944d293"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:39.021838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0830d301-8733-43d6-8935-1e05c9511304 req-3cc5bb81-e5e2-4fd3-90d1-47b810c57d51 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.022569 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0830d301-8733-43d6-8935-1e05c9511304 req-3cc5bb81-e5e2-4fd3-90d1-47b810c57d51 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:39.038442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-0830d301-8733-43d6-8935-1e05c9511304 req-3cc5bb81-e5e2-4fd3-90d1-47b810c57d51 service nova] Creating event network-vif-unplugged:cb2971f9-bb02-4c16-9542-d77ac944d293 for instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 on hv-cinder-82635 Jun 14 18:01:39.043839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-0830d301-8733-43d6-8935-1e05c9511304 req-3cc5bb81-e5e2-4fd3-90d1-47b810c57d51 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035557 Jun 14 18:01:39.047391 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 253/502] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:39.080305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:39.088183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4c88c5a1-4a12-4c0c-8076-25aacdc0d561 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.205737 Jun 14 18:01:39.088745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 250/503] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:38 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:39.309188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:39.309808 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:39.317083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.317546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:39.318361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.318886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:39.490399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:39.501937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:39.504061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:39.505134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bdcc8c8c-bf08-4ae0-bd1b-dc3eb72e94ee tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.200422 Jun 14 18:01:39.505736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 254/504] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:39 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:39.746093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:39.746865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:39.758055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.758691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:39.759654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.760372 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:39.986224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:39.987153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:39.994650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.995096 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:39.996179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:39.996630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:40.001595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:40.033182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:40.045295 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-20b18090-d774-4909-90c8-6fe2e156c595 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.303030 Jun 14 18:01:40.056400 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 251/505] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:39 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:40.109707 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:40.111444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:40.130865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:40.131536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:40.132510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:40.133270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:40.192933 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:40.202714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-02fa4dbd-2d52-4572-ad03-8ea4ce3869df tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1514 microversion: 2.1 time: 0.220979 Jun 14 18:01:40.203652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 255/506] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:39 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:40.394917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-78c9db6d-f3fd-4986-bf74-581f3139e6d3 req-e18a8a39-9718-4aca-81c3-087d18fcf7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfba6f52-c4c7-410c-8d59-4fd9e65c3664", "name": "network-vif-deleted", "tag": "cb2971f9-bb02-4c16-9542-d77ac944d293"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:40.396964 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:40.404445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-78c9db6d-f3fd-4986-bf74-581f3139e6d3 req-e18a8a39-9718-4aca-81c3-087d18fcf7ad service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:40.409946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-78c9db6d-f3fd-4986-bf74-581f3139e6d3 req-e18a8a39-9718-4aca-81c3-087d18fcf7ad service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:40.411933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-882f8459-4f57-4866-a402-de749befcf08 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.308144 Jun 14 18:01:40.413397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 252/507] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:40 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:40.425652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-78c9db6d-f3fd-4986-bf74-581f3139e6d3 req-e18a8a39-9718-4aca-81c3-087d18fcf7ad service nova] Creating event network-vif-deleted:cb2971f9-bb02-4c16-9542-d77ac944d293 for instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 on hv-cinder-82635 Jun 14 18:01:40.434079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-78c9db6d-f3fd-4986-bf74-581f3139e6d3 req-e18a8a39-9718-4aca-81c3-087d18fcf7ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045022 Jun 14 18:01:40.434721 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 256/508] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:40.525003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:40.525626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:40.532938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:40.542893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:40.542893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:40.542893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:40.882796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:40.899381 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:40.901637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:40.903144 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-89f13e80-85a8-452c-b820-8506197bc17a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.382660 Jun 14 18:01:40.903945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 253/509] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:40 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:41.074777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:41.075936 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:41.088653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.089450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.090701 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.091219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.230577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:41.231747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:41.248889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.249928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.252489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.253227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.382481 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:41.400439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e0d744a4-36eb-426d-8aca-8526232afdbb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1472 microversion: 2.1 time: 0.177471 Jun 14 18:01:41.401942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 254/510] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:41 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:41.435652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:41.437234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:41.468672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.469690 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.476782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:41.478350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.479237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.493050 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8396369d-3aad-4bfc-b87b-8cf75ed4ad22 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.424955 Jun 14 18:01:41.494865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 257/511] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:41 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:41.514324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:41.931372 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:41.932749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:41.949244 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.950067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:41.953083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:41.953799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.251915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:42.270460 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:42.272584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:42.276436 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5150c6d4-dbc4-45fe-b643-97e8e4515eb9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.351156 Jun 14 18:01:42.276436 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 258/512] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:41 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:42.276759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:42.279979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-725dd0e1-7c35-474e-b459-8721f9d04ee4 req-bb482b0a-23ae-4d58-b3d3-74aca0bd4bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d6039e6-24eb-49c5-903a-24dca8d10840", "name": "network-vif-deleted", "tag": "ce833eb3-5cc0-4ce3-8afc-e9f8280df452"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:42.289483 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-725dd0e1-7c35-474e-b459-8721f9d04ee4 req-bb482b0a-23ae-4d58-b3d3-74aca0bd4bf1 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:42.289939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-725dd0e1-7c35-474e-b459-8721f9d04ee4 req-bb482b0a-23ae-4d58-b3d3-74aca0bd4bf1 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.290844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-60e24960-455f-40ec-badc-c7c682abc3c0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 200 len: 1504 microversion: 2.1 time: 0.862086 Jun 14 18:01:42.306919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-725dd0e1-7c35-474e-b459-8721f9d04ee4 req-bb482b0a-23ae-4d58-b3d3-74aca0bd4bf1 service nova] Creating event network-vif-deleted:ce833eb3-5cc0-4ce3-8afc-e9f8280df452 for instance 1d6039e6-24eb-49c5-903a-24dca8d10840 on hv-cinder-82635 Jun 14 18:01:42.307336 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 255/513] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:41 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 1504 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:42.312237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-725dd0e1-7c35-474e-b459-8721f9d04ee4 req-bb482b0a-23ae-4d58-b3d3-74aca0bd4bf1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036430 Jun 14 18:01:42.312863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 259/514] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:01:42.426498 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:42.427181 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:42.433925 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:42.434672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.435563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:42.436095 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.478395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:42.479526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.480499 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lazy-loading 'fault' on Instance uuid dfba6f52-c4c7-410c-8d59-4fd9e65c3664 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:42.520364 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:42.520974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:42.528157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:42.528605 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.529394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:42.529863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:42.604761 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:42.615577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ec1f0e24-f920-4e8d-98c2-acd6ca268b36 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 200 len: 1309 microversion: 2.1 time: 0.193736 Jun 14 18:01:42.617883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 256/515] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:42 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:42.715993 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:42.730786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-041c60b5-2c11-4bda-a486-86ba5bcb9fa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1682 microversion: 2.1 time: 0.215642 Jun 14 18:01:42.743091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 260/516] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:42 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:43.146820 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-7f22dbbd-aea5-4e75-914c-9c683e78ce13 req-a3d0df24-488e-4c79-be7b-cfc729f9887a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "name": "network-vif-plugged", "status": "completed", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:43.150036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1732682565", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de68c879-6907-4604-9b5a-490a31e5606e"}], "security_groups": [{"name": "tempest-securitygroup--1281144312"}], "key_name": "tempest-keypair-1912862043", "user_data": "}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:43.160114 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7f22dbbd-aea5-4e75-914c-9c683e78ce13 req-a3d0df24-488e-4c79-be7b-cfc729f9887a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.160837 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7f22dbbd-aea5-4e75-914c-9c683e78ce13 req-a3d0df24-488e-4c79-be7b-cfc729f9887a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.182039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-7f22dbbd-aea5-4e75-914c-9c683e78ce13 req-a3d0df24-488e-4c79-be7b-cfc729f9887a service nova] Creating event network-vif-plugged:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 18:01:43.189715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-7f22dbbd-aea5-4e75-914c-9c683e78ce13 req-a3d0df24-488e-4c79-be7b-cfc729f9887a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051219 Jun 14 18:01:43.190399 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 257/517] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:01:43.313391 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] validate_networks() for [('de68c879-6907-4604-9b5a-490a31e5606e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:01:43.314253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:43.315361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:43.345919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.347566 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.349534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.351004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.815704 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:43.827746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:43.829366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:43.831579 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-af3aa4bc-416d-45c3-9bad-46d2c3d4d676 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.529934 Jun 14 18:01:43.847415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 258/518] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:43 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:43.847415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:43.847415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: 1d6039e6-24eb-49c5-903a-24dca8d10840] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:43.847415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.847415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.853647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.853647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.865868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] HTTP exception thrown: Instance 1d6039e6-24eb-49c5-903a-24dca8d10840 could not be found. Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Request method failure captured: Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 HTTP/1.1 Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMzSv7571UktpU-_iBzkJim0pcLP7NCL9LO61ptUGzbKlQlsE-ZvJroPfYV-xTKOH84mabKErZ6N6Sr2ajCoJlfwp_sYmlglABlzmlS1IWpj39qFxKRufLIu4vrIR9z4S3DGAoRE-l64ZKWpwQ2kkRdFOtj5bT1NODeS3mXaedbDd1M Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 3412103661474550b6c9926648e13ab6 Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesActionsTest-1687308910 Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:01:43.867621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3412103661474550b6c9926648e13ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3412103661474550b6c9926648e13ab6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3412103661474550b6c9926648e13ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3412103661474550b6c9926648e13ab6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesActionsTest-1687308910 Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 3412103661474550b6c9926648e13ab6 Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesActionsTest-1687308910 Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesActionsTest-1687308910-project Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 4fdef75ae06e47a5a2632acd314d3de6 Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesActionsTest-1687308910-project Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 1d6039e6-24eb-49c5-903a-24dca8d10840 could not be found. Jun 14 18:01:43.870497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '1d6039e6-24eb-49c5-903a-24dca8d10840'} Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d6039e6-24eb-49c5-903a-24dca8d10840 could not be found. Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:01:43.871480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d6039e6-24eb-49c5-903a-24dca8d10840 could not be found. Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d6039e6-24eb-49c5-903a-24dca8d10840 could not be found. Jun 14 18:01:43.873722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.875171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Returning 404 to user: Instance 1d6039e6-24eb-49c5-903a-24dca8d10840 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:01:43.875171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d4937462-6097-43de-8031-9d7dac9c3729 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840" status: 404 len: 111 microversion: 2.1 time: 0.035445 Jun 14 18:01:43.875171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 259/519] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:43 2022] GET /compute/v2.1/servers/1d6039e6-24eb-49c5-903a-24dca8d10840 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:01:43.897785 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:43.900378 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: dfba6f52-c4c7-410c-8d59-4fd9e65c3664] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:43.915068 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.915568 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.917218 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.920288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.946157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] HTTP exception thrown: Instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 could not be found. Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Request method failure captured: Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 HTTP/1.1 Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMyPRDd1vNojb4jAN2kMR2m7bxXLoCEc2XGFUJpkaMNH5Tv56-FlBozyZeb5FVVt2sF-znjDQTMJJWBdvoBkMCQPO9H8wFlrHSr1GGI9LwmFEfiKo3EP6lVX27ECVQMljWij583qNjPdYOL8-Ss5sADDCjCbwgcDWca30RVKql6LTUo Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 5a142734eadd40fb908c7bd115c81ee4 Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesSnapshotTestJSON-765847843 Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:01:43.948373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a142734eadd40fb908c7bd115c81ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a142734eadd40fb908c7bd115c81ee4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a142734eadd40fb908c7bd115c81ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a142734eadd40fb908c7bd115c81ee4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesSnapshotTestJSON-765847843 Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 5a142734eadd40fb908c7bd115c81ee4 Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-765847843 Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesSnapshotTestJSON-765847843-project Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: e73368f3ce8a43368b30985898cf7393 Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesSnapshotTestJSON-765847843-project Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 could not be found. Jun 14 18:01:43.949713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'dfba6f52-c4c7-410c-8d59-4fd9e65c3664'} Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 could not be found. Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:01:43.950547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 could not be found. Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 could not be found. Jun 14 18:01:43.951734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:01:43.955932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Returning 404 to user: Instance dfba6f52-c4c7-410c-8d59-4fd9e65c3664 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:01:43.957200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0d14aac2-2d1e-4046-acf2-924b551553c1 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664" status: 404 len: 111 microversion: 2.1 time: 0.074044 Jun 14 18:01:43.958065 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 260/520] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:43 2022] GET /compute/v2.1/servers/dfba6f52-c4c7-410c-8d59-4fd9e65c3664 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:01:43.982175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:43.985004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:43.990336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:01:43.990763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:01:43.991232 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:01:43.992020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:01:43.992565 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:01:43.995069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.995857 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:43.996934 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:43.997766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:44.010951 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:44.014908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:44.014908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:44.014908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:44.068469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:01:44.082339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Getting quotas for user 7f214333671e4878bf613c26ceb1381a and project 6c8e2494e0744c778b32f979005ec7ab. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:01:44.120042 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:01:44.126220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:01:44.180069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:44.192107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-006f7f5f-7a49-41ad-9609-114b51a21547 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1614 microversion: 2.1 time: 0.232167 Jun 14 18:01:44.194558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 261/521] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:43 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1614 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:44.205384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1302998852", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "networks": [{"uuid": "c469c60e-7a30-4b06-a30d-1c1e2a3b8f97"}]}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:44.251123 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:44.331293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] validate_networks() for [('c469c60e-7a30-4b06-a30d-1c1e2a3b8f97', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:01:44.382823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a162788b-7985-46f0-a012-58ea8cf5d759 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.244481 Jun 14 18:01:44.385305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 261/522] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:01:43 2022] POST /compute/v2.1/servers => generated 409 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:01:44.396643 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-6020766c-e1ea-4aa3-ad7e-409b37f25dc1 req-2f1a2cc3-85e4-4eaf-88aa-0748c6a0b8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2", "name": "network-vif-deleted", "tag": "2c0fc3b7-0d5f-4866-8a2c-702a71a3e053"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:44.415892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-6020766c-e1ea-4aa3-ad7e-409b37f25dc1 req-2f1a2cc3-85e4-4eaf-88aa-0748c6a0b8a6 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:44.417157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-6020766c-e1ea-4aa3-ad7e-409b37f25dc1 req-2f1a2cc3-85e4-4eaf-88aa-0748c6a0b8a6 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:44.444060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-6020766c-e1ea-4aa3-ad7e-409b37f25dc1 req-2f1a2cc3-85e4-4eaf-88aa-0748c6a0b8a6 service nova] Creating event network-vif-deleted:2c0fc3b7-0d5f-4866-8a2c-702a71a3e053 for instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 on hv-cinder-82635 Jun 14 18:01:44.457635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-6020766c-e1ea-4aa3-ad7e-409b37f25dc1 req-2f1a2cc3-85e4-4eaf-88aa-0748c6a0b8a6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069966 Jun 14 18:01:44.458897 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 262/523] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:01:44.487705 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ec7f1e78-a3e6-4f04-aadc-eec441861e1b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:44.489291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ec7f1e78-a3e6-4f04-aadc-eec441861e1b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:44.649637 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ec7f1e78-a3e6-4f04-aadc-eec441861e1b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:44.678301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ec7f1e78-a3e6-4f04-aadc-eec441861e1b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1246 microversion: 2.1 time: 0.217484 Jun 14 18:01:44.690886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 263/524] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:44 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1246 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:44.867040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:44.867891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:44.878349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:44.879571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:44.881848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:44.882538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:45.067155 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:45.077081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:01:45.078593 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:01:45.080160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:01:45.080773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:01:45.081294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:01:45.082391 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:45.084284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:45.086099 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2c899427-4515-4edc-9374-c71320c0bf7a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.224271 Jun 14 18:01:45.087478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 264/525] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:44 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:45.094541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:45.096517 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:45.097567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:45.098232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:45.133568 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Getting quotas for project 3412103661474550b6c9926648e13ab6. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:01:45.138594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Getting quotas for user 4fdef75ae06e47a5a2632acd314d3de6 and project 3412103661474550b6c9926648e13ab6. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:01:45.153042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:01:45.155582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:01:45.230768 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:45.232486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:45.246935 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:45.248023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:45.250106 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:45.251628 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:45.293429 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:45.294207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:45.294878 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:45.338598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b2fa7578-f84e-4d0e-8e08-a6f896c1bdf3 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141970 Jun 14 18:01:45.346605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 262/526] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:01:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:01:45.353841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:45.364503 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-604a4742-d9ed-466b-8ac5-c0fcdd10d1fd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1331 microversion: 2.1 time: 0.141347 Jun 14 18:01:45.367554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 265/527] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:45 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1331 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:45.369472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fa466ee0-b0ab-4db6-bd05-fd18b225315c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:45.371779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fa466ee0-b0ab-4db6-bd05-fd18b225315c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:45.453615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fa466ee0-b0ab-4db6-bd05-fd18b225315c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:45.469648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fa466ee0-b0ab-4db6-bd05-fd18b225315c tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1214 microversion: 2.1 time: 0.112983 Jun 14 18:01:45.473112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 263/528] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:45 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:45.716784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-33505795-2bef-430a-bb99-4b07a5d8af44 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:45.719063 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-33505795-2bef-430a-bb99-4b07a5d8af44 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:45.805633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-33505795-2bef-430a-bb99-4b07a5d8af44 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:45.822334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-33505795-2bef-430a-bb99-4b07a5d8af44 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1246 microversion: 2.1 time: 0.115788 Jun 14 18:01:45.823432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 266/529] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:45 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:46.122824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:46.124192 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:46.127855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:46.139202 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.140163 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.142210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.143609 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.353507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:46.369624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:46.371533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:46.381938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-caaa41d5-b739-4108-aa11-50ad3d6e3f9e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.258080 Jun 14 18:01:46.381938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 264/530] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:46 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:46.389350 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:46.390030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:46.398511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.398990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.399847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.400293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.440741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.441189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.441656 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:46.492633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:46.494635 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-78058bc1-d43d-4b29-8aa8-c778f923abda tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:46.495855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-78058bc1-d43d-4b29-8aa8-c778f923abda tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:46.506757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7ffda4fd-1f27-4bcb-8d2b-1791a449eb23 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1331 microversion: 2.1 time: 0.121051 Jun 14 18:01:46.507756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 267/531] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:46 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:46.570427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-78058bc1-d43d-4b29-8aa8-c778f923abda tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:46.582941 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-78058bc1-d43d-4b29-8aa8-c778f923abda tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1214 microversion: 2.1 time: 0.096416 Jun 14 18:01:46.583580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 265/532] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:46 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:46.853498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:46.854312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:46.863543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.864295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.865327 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:46.865907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:46.931029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:46.942091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-76f0d766-4d22-48b8-bff1-492c8edfc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1250 microversion: 2.1 time: 0.094212 Jun 14 18:01:46.943056 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 268/533] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:46 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:47.392292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:47.392870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:47.400394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.400851 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.401652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.402099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.533923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:47.534698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:47.542228 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.542688 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.543544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.543986 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.569059 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:47.578979 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:47.580733 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:47.580993 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.581519 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.581858 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:47.582270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-25cd5c1b-ba1c-4611-a6bb-ed7e585184ba tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.194541 Jun 14 18:01:47.582934 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 266/534] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:47 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:47.600878 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:47.601497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:47.608054 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.608500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.609326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.609773 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.636915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:47.645941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d2543476-3ae5-4d84-af84-395cae39c47e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1331 microversion: 2.1 time: 0.116620 Jun 14 18:01:47.646427 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 269/535] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:47 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:47.704527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:47.712703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ea5f1367-b214-4a20-921e-326f94586ac2 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1218 microversion: 2.1 time: 0.115611 Jun 14 18:01:47.713364 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 267/536] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:47 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:47.968208 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:47.968848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:47.977612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.978093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:47.978886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:47.979345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.045351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:48.053812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-657b2437-4366-4140-b1ca-e0cb0d05acc5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1250 microversion: 2.1 time: 0.089421 Jun 14 18:01:48.055052 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 270/537] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:47 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:48.605942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:48.607063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:48.619876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.620670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.622098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.622913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.669915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:48.670630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:48.682672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.684433 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.688290 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.689849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.762205 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.762882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.763635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:48.840792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:48.856807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e31c8a8e-e16d-4d27-8a13-6358ec144c1c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 200 len: 1331 microversion: 2.1 time: 0.194418 Jun 14 18:01:48.867142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 271/538] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:48 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 1331 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:48.868254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:48.868850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:48.882793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.884006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.885755 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:48.886555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:48.893321 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:48.901817 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:48.903539 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:48.904827 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-3770a22c-3b44-426a-a8d1-ef514f7777b4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.306397 Jun 14 18:01:48.905396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 268/539] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:48 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:48.979965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:48.994544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bbb81d3f-5e65-4392-ad52-6bc8439fc3f1 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1218 microversion: 2.1 time: 0.134136 Jun 14 18:01:49.002720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 272/540] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:48 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:49.071241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:49.071895 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:49.078300 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:49.078762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:49.080354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:49.080800 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:49.169598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:49.184746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7c4d8ecd-3ade-4b2d-bf58-3935b77d7b21 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1242 microversion: 2.1 time: 0.116882 Jun 14 18:01:49.185992 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 269/541] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:49 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1242 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:49.882856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:49.892583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:49.905341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:49.905794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:49.907005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:49.908216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:49.928514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 HTTP/1.1 Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:01:49.931866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:01:49.933482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2'} Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:01:49.934425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:01:49.937137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:01:49.939436 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:01:49.939436 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0a7b914c-08b7-4d5e-8af3-676ca0be54a3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 404 len: 111 microversion: 2.1 time: 0.061311 Jun 14 18:01:49.940899 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 273/542] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:49 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:01:49.941704 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:49.942620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:49.946943 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8a066a34-ebfa-4556-ad19-a9a5fe636ca5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '.version_select at 0x7fbafc863dc0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:49.949570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:49.950128 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:49.952548 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:49.959780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:50.072089 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8a066a34-ebfa-4556-ad19-a9a5fe636ca5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698912452" status: 202 len: 0 microversion: 2.1 time: 0.129930 Jun 14 18:01:50.078584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 274/543] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 14 18:01:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698912452 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:01:50.082218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:50.082835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:50.094519 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:50.096020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:50.097687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:50.099774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:50.145081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:50.161039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:50.163744 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:50.165995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4ef65a3b-5eca-40fc-8689-24d8beae3a7c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1809 microversion: 2.20 time: 0.231278 Jun 14 18:01:50.167022 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 270/544] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:49 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:01:50.198790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:50.212262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ce643078-fe2a-42f2-85ce-9340b4392b8a tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1266 microversion: 2.1 time: 0.134303 Jun 14 18:01:50.212928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:50.217737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 275/545] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:50 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1266 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:50.217983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:50.221620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:50.222099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:50.223055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:50.223748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:50.318129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:50.326972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c4499216-0742-4111-a27c-1403ed6dc78e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1298 microversion: 2.1 time: 0.118284 Jun 14 18:01:50.330457 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 271/546] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:50 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:51.192469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:51.215596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:51.241046 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:51.241873 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:51.245893 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.253022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.256222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.262076 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.271108 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.271472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.274960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.275604 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.455111 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:51.469436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6ce17285-817c-40e4-a50e-3b47f62f89ac tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1272 microversion: 2.1 time: 0.232666 Jun 14 18:01:51.472130 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 272/547] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:51 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:51.490994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:51.492428 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:51.503153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.503745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.505113 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.505701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.639927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:51.647283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:51.660853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:51.664289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:51.667114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-aaca5ac0-2c7a-4644-b1b7-96264e8323d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1796 microversion: 2.20 time: 0.483264 Jun 14 18:01:51.668224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 276/548] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:01:51 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1796 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:01:51.848422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:51.848931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:51.856091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.856415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.863091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:51.863091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:51.875889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:51.930626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a361ab9c-840d-42ce-af83-26a8bd8703ff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1304 microversion: 2.1 time: 0.456233 Jun 14 18:01:51.931732 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 273/549] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:51 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1304 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:51.980355 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lazy-loading 'services' on Instance uuid d2412cb1-a36e-4e84-92d7-ca0c179b6993 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:52.034159 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:52.035802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:52.066895 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.067543 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.068664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.070513 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.288197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c27b05df-1d5a-4c5a-9cf1-1b4224a83da8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-volume_attachments/d4457390-52c4-47e9-a722-cdcea140c312" status: 202 len: 0 microversion: 2.1 time: 0.445361 Jun 14 18:01:52.289461 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 277/550] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:01:51 2022] DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-volume_attachments/d4457390-52c4-47e9-a722-cdcea140c312 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:01:52.304118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'services' on Instance uuid 97278dbc-a791-43fb-b077-cd4f0a0bebf7 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:01:52.497706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:52.498686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:52.510792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.512013 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.513509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.514527 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.686007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:52.694929 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-36df6082-d3bf-4d38-918b-88aca46355b0 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.201894 Jun 14 18:01:52.695669 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 278/551] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:52 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:52.738539 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f497f0bb-f4a1-46e6-9a94-1861f3770323 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments/d18715c6-5143-44d3-ae89-fcddbe347f3e" status: 202 len: 0 microversion: 2.1 time: 0.715012 Jun 14 18:01:52.739162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 274/552] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:01:52 2022] DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments/d18715c6-5143-44d3-ae89-fcddbe347f3e => generated 0 bytes in 717 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:01:52.747943 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:52.749158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:52.756384 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.756857 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.757643 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.758093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.793312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-53cab98a-7b50-45c0-a9cf-aff5fbe3d0e6 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049364 Jun 14 18:01:52.793916 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 279/553] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:01:52 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:52.950549 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:52.951249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:52.959785 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.960342 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.961220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:52.961703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:52.983676 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:53.116160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:53.125109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d104b594-c48c-4627-955f-d51ca21c2689 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.179233 Jun 14 18:01:53.125709 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 275/554] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:52 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:53.722184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:53.723002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:53.732890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:53.733798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:53.735239 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:53.736380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:53.806929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:53.807987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:53.815942 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:53.816383 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:53.817160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:53.817589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:53.853156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2a87c150-cb3f-42a3-ab79-5cf8fe940531 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050403 Jun 14 18:01:53.853743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 276/555] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:01:53 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:53.911379 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:53.919867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f8fc9dea-463e-4649-b70d-56231ebb8178 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.201807 Jun 14 18:01:53.920486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 280/556] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:53 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:54.151833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:54.152500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:54.159386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:54.159918 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:54.160727 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:54.161175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:54.331820 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:54.340975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e500b85b-287f-4777-9b8b-8a91640956e6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.193356 Jun 14 18:01:54.341885 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 277/557] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:54 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:54.867925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:54.869261 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:54.879934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:54.884404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:54.885202 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:54.887727 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:54.888967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:54.942692 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:54.943807 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:54.952571 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:54.953301 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:54.953877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e5fde522-4243-481c-9de0-a18dc393947d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090438 Jun 14 18:01:54.955486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 281/558] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:01:54 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:54.955933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:54.956764 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:55.118660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:55.270641 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:55.284000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cfdfd763-0436-42ae-95c3-b73e68bc8757 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.348376 Jun 14 18:01:55.286787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 278/559] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:54 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:55.361738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:55.362803 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:55.370744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:55.376719 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:55.376719 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:55.376719 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:55.623592 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-3c8a3192-bf93-405b-855c-8e0a3ebb5305 req-0b8f2560-367c-4e9f-a333-aa580148aeda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b796fc82-5a9a-4929-af85-b0c291d5c844", "tag": "cae630ba-1eae-47ab-82c0-b88adf43f6bd"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:55.642289 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-3c8a3192-bf93-405b-855c-8e0a3ebb5305 req-0b8f2560-367c-4e9f-a333-aa580148aeda service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:55.643913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-3c8a3192-bf93-405b-855c-8e0a3ebb5305 req-0b8f2560-367c-4e9f-a333-aa580148aeda service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:55.668052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-3c8a3192-bf93-405b-855c-8e0a3ebb5305 req-0b8f2560-367c-4e9f-a333-aa580148aeda service nova] Creating event network-changed:cae630ba-1eae-47ab-82c0-b88adf43f6bd for instance b796fc82-5a9a-4929-af85-b0c291d5c844 on hv-cinder-82635 Jun 14 18:01:55.682404 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-3c8a3192-bf93-405b-855c-8e0a3ebb5305 req-0b8f2560-367c-4e9f-a333-aa580148aeda service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062132 Jun 14 18:01:55.683866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 279/560] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:01:55.815129 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=10 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:55.820374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-879547395", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "networks": [{"uuid": "4d337caa-bf92-4f7f-8794-6bc4677d3709"}]}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:55.827134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:55.836650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f5c1f1ed-665f-4462-92e1-a9ff1c987f8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.479028 Jun 14 18:01:55.837273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 282/561] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:55 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:55.899828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] validate_networks() for [('4d337caa-bf92-4f7f-8794-6bc4677d3709', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:01:55.967850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-bba304e9-013b-4fa7-86fd-99722613ddcb req-1f6f89fa-c5b8-4554-95ad-393d62239a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4183d50a-65d3-47a0-90bd-ec11efad799a", "tag": "1fcab755-2ded-49b3-bc1b-1d3480979cd3"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:55.991073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-bba304e9-013b-4fa7-86fd-99722613ddcb req-1f6f89fa-c5b8-4554-95ad-393d62239a8f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:55.991073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-bba304e9-013b-4fa7-86fd-99722613ddcb req-1f6f89fa-c5b8-4554-95ad-393d62239a8f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.035666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-bba304e9-013b-4fa7-86fd-99722613ddcb req-1f6f89fa-c5b8-4554-95ad-393d62239a8f service nova] Creating event network-changed:1fcab755-2ded-49b3-bc1b-1d3480979cd3 for instance 4183d50a-65d3-47a0-90bd-ec11efad799a on hv-cinder-82635 Jun 14 18:01:56.047010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-bba304e9-013b-4fa7-86fd-99722613ddcb req-1f6f89fa-c5b8-4554-95ad-393d62239a8f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087339 Jun 14 18:01:56.051018 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 283/562] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:01:56.058622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:56.060555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:56.070074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.074537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.074537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.074537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.149244 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4dfc0b28-22f4-4916-bcdd-df50eb4a0eaf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.096204 Jun 14 18:01:56.150690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 284/563] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:01:56 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:01:56.288733 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:56.290216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:56.307119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.308131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.309570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.310681 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.396469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:01:56.583570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=14 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:56.769479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:01:56.770187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:01:56.771016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:01:56.772281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:01:56.772982 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:01:56.802854 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.803347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.808152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.809936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.850004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Getting quotas for project 5a142734eadd40fb908c7bd115c81ee4. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:01:56.853947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Getting quotas for user e73368f3ce8a43368b30985898cf7393 and project 5a142734eadd40fb908c7bd115c81ee4. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:01:56.878173 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c9c6fa57-2f8f-4dc7-b42e-43b072286971 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 204 len: 0 microversion: 2.1 time: 0.597722 Jun 14 18:01:56.878677 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:01:56.881450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 285/564] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:01:56 2022] DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:01:56.881697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:01:56.887853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:56.888948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:56.899127 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.899901 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:56.901556 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:56.902140 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.036412 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-561170b1-79f0-4a05-9184-27244a6c97bb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.223896 Jun 14 18:01:57.045521 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 280/565] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:01:57.047318 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:57.048685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:57.063921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.064882 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.066215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.066802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.073172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:57.085179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4e79d41e-b470-436f-8e2e-dc9840a33421 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.203937 Jun 14 18:01:57.086127 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 286/566] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:56 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:57.092506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eaca819c-932e-45f2-8085-e4336843bb0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:01:57.102289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eaca819c-932e-45f2-8085-e4336843bb0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.102994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eaca819c-932e-45f2-8085-e4336843bb0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.150175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-eaca819c-932e-45f2-8085-e4336843bb0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Going to try to stop instance {{(pid=125161) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 14 18:01:57.315963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:57.324782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-816c69be-196d-4e5f-8e22-796595f1f2d8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.285301 Jun 14 18:01:57.325383 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 281/567] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:57 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:57.330857 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:57.331541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:57.338512 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.338880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.339707 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.340152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.390151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-eaca819c-932e-45f2-8085-e4336843bb0d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action" status: 202 len: 0 microversion: 2.1 time: 0.301884 Jun 14 18:01:57.390834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 287/568] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:01:57 2022] POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:01:57.402117 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8668e48e-87d3-4198-b589-16ee90862ccd tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:57.403200 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8668e48e-87d3-4198-b589-16ee90862ccd tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:57.484674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8668e48e-87d3-4198-b589-16ee90862ccd tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:57.494380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8668e48e-87d3-4198-b589-16ee90862ccd tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1218 microversion: 2.1 time: 0.098333 Jun 14 18:01:57.495137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 288/569] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:57 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:57.505570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:57.506737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:57.512581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:57.518761 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.519404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.524809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:57.524809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:57.525279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8c60bdf8-26ea-418a-959e-c62d3c0e42d7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1679 microversion: 2.1 time: 0.195246 Jun 14 18:01:57.525279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 282/570] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:57 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:57.676713 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:57.686114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2c1fa29c-7e6a-4a3f-9302-287fdf6af981 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1724 microversion: 2.1 time: 0.189334 Jun 14 18:01:57.686709 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 289/571] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:57 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:58.102424 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:58.104090 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:58.109696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.110158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.111158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.111620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.269315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:58.278273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cbb1a1c3-6e37-479f-9610-7e28046ca9ba tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.179879 Jun 14 18:01:58.278881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 283/572] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:58 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:58.346191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:58.347042 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:58.354487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.365068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.365068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.365068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.511996 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:58.521114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-68947c98-6394-42fb-a410-bef72996b0f5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.179568 Jun 14 18:01:58.522037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 290/573] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:58 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:58.524135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:58.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:58.538369 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.539123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.540294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.540970 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.541304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:58.541722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:58.549705 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.550179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.550988 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.551473 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.621498 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:58.635235 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-010e32c7-6315-4097-b3f5-3011fdc7b683 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1222 microversion: 2.1 time: 0.116226 Jun 14 18:01:58.636432 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 284/574] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:58 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:58.707080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:58.707080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:58.714293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.714951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.716270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:58.716976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:58.721322 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:58.726571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:01:58.752454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-29e94ebb-d7ca-467a-9f2a-8526c9d90f5e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1679 microversion: 2.1 time: 0.214270 Jun 14 18:01:58.753507 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 291/575] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:58 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:58.894941 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:58.908301 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-974802de-52b0-4972-a46e-d2de1e5a7393 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.205917 Jun 14 18:01:58.909344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 285/576] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:58 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:01:59.298422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:59.299200 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:59.307326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.307923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.308880 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.309444 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.550414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:59.553147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:59.564214 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.565513 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.567332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.568050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.673367 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:59.693337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bf45bc9f-12f4-4856-8da1-49b6e9907d6d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.399497 Jun 14 18:01:59.695060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 292/577] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:59 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:59.704839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:59.706440 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:59.719645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.720917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.722393 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.723204 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.837442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:01:59.847540 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-be956f13-4f52-4596-85f2-2602503caacb tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1214 microversion: 2.1 time: 0.150418 Jun 14 18:01:59.858831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 293/578] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:59 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:01:59.873451 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:01:59.874090 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:01:59.881034 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.881495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:01:59.882300 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:01:59.882749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.101096 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:00.119609 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9220ec3e-dac2-481e-b885-76a9edd21a19 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.575435 Jun 14 18:02:00.121204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 286/579] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:59 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:00.132276 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:00.133515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:00.146536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:00.150974 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.150974 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:00.150974 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.190222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:00.209415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7c3c650c-046d-407b-a780-44c4f1956be4 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1679 microversion: 2.1 time: 0.348369 Jun 14 18:02:00.210652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 294/580] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:01:59 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1679 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:00.714110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:00.715018 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:00.725401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:00.725855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.726843 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:00.727288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.890257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:00.900046 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7961d105-ccf2-4df0-9ce3-f046c0f90104 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.192446 Jun 14 18:02:00.906237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 295/581] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:00 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:00.912406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:00.913432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:00.920508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:00.921051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.921906 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:00.922408 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:00.993293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:01.007966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d0807023-15ad-4de2-b414-36332f6f3939 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.884529 Jun 14 18:02:01.009047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 287/582] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:00 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:01.013194 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:01.034095 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cf5a9c45-47d4-4b7c-baf8-3c4957a06385 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1270 microversion: 2.1 time: 0.131218 Jun 14 18:02:01.035169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 296/583] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:00 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:01.144492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:01.145618 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:01.153694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.154322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:01.155421 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.155968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:01.242072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:01.242765 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:01.250635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.252277 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:01.253134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.253646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:01.355363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:01.368923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-994a165f-c370-4732-9cdd-0072e699d272 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1612 microversion: 2.1 time: 0.135064 Jun 14 18:02:01.369599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 297/584] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:01 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1612 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:01.464119 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:01.481250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4b172fa2-8d5a-48a6-8b86-6458ace063c8 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.344723 Jun 14 18:02:01.482997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 288/585] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:01 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:01.941224 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-687b1794-4e7a-4a05-b81d-9c076bc8bdf4 req-78c03123-ddc1-406f-80f1-97a60ee1b279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97278dbc-a791-43fb-b077-cd4f0a0bebf7", "name": "network-vif-deleted", "tag": "308799a5-8ca4-4e1c-ae5f-b7ca777bdb74"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:01.945594 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:01.953340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:01.978131 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-687b1794-4e7a-4a05-b81d-9c076bc8bdf4 req-78c03123-ddc1-406f-80f1-97a60ee1b279 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.979644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.980582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:01.982316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:01.983377 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:01.991036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-687b1794-4e7a-4a05-b81d-9c076bc8bdf4 req-78c03123-ddc1-406f-80f1-97a60ee1b279 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.005214 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-687b1794-4e7a-4a05-b81d-9c076bc8bdf4 req-78c03123-ddc1-406f-80f1-97a60ee1b279 service nova] Creating event network-vif-deleted:308799a5-8ca4-4e1c-ae5f-b7ca777bdb74 for instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 on hv-cinder-82635 Jun 14 18:02:02.012398 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-687b1794-4e7a-4a05-b81d-9c076bc8bdf4 req-78c03123-ddc1-406f-80f1-97a60ee1b279 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079321 Jun 14 18:02:02.013642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 289/586] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:02.030459 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:02.031643 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:02.041815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.042541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.046185 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.046922 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.333052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:02.337618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:02.353644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-841e2f3c-5a9b-4a81-ae87-5c31a3423a2b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.435817 Jun 14 18:02:02.359886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 298/587] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:01 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:02.365016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-48f9aff6-c489-4e4b-8d96-7500634a3046 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.338571 Jun 14 18:02:02.367253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 290/588] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:02 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:02.385504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:02.386800 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:02.399231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:02.400024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:02.402105 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.403347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.405191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.406347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.408989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.409555 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.410545 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.411003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.453976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.455003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.456649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 97278dbc-a791-43fb-b077-cd4f0a0bebf7 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:02.554463 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:02.567577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-3f28e2bd-a41f-45eb-a800-8a1706b1742c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 200 len: 1330 microversion: 2.1 time: 0.182581 Jun 14 18:02:02.573415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 291/589] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:02 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 1330 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:02.582454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:02.585361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:02.586283 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:02.598857 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.599666 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.601848 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:02.602561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:02.604658 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b2faa54b-aad6-45d3-a6a7-6388792cf651 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1276 microversion: 2.1 time: 0.244502 Jun 14 18:02:02.606270 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 299/590] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:02 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:02.862545 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:02.890600 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5daa8d22-c1d1-42d2-a656-725242e0af09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.309282 Jun 14 18:02:02.890600 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 292/591] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:02 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:03.399954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:03.401319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:03.406592 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:03.406919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:03.408810 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:03.419960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.421122 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.422150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.422962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.423396 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.424363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.424548 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.425109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.663522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:03.669146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-56b686c3-314b-443f-b892-e1f54f94ffa9 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.284204 Jun 14 18:02:03.669868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 300/592] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:03 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:03.675882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:03.676909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:03.684317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.685242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.686287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.686994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.704856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 HTTP/1.1 Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:02:03.707748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:02:03.709201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '97278dbc-a791-43fb-b077-cd4f0a0bebf7'} Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:02:03.709962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:02:03.711291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:03.712444 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:02:03.712534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c25d278b-0606-45f0-a740-0a6c048bdd46 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 404 len: 111 microversion: 2.1 time: 0.041078 Jun 14 18:02:03.714443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 301/593] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:03 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:02:03.719171 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:03.726140 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:03.726788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.727252 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.728390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.728852 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.837906 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:03.841746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:03.858104 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-da64ed61-84f0-4993-9e82-16d5415df2f3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.456239 Jun 14 18:02:03.858104 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 293/594] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:03 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:03.879337 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c6084b7-11f2-4a5a-8385-9198ad015ce3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '.version_select at 0x7fbafc19b1f0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:03.941686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:03.959194 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9311d195-7eaf-4927-b693-26e7ddc90b1b tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.243399 Jun 14 18:02:03.972072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 302/595] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:03 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:03.976165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:03.977311 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:03.989388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.990210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:03.991663 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:03.992446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:04.004852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4c6084b7-11f2-4a5a-8385-9198ad015ce3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-765269263" status: 202 len: 0 microversion: 2.1 time: 0.148258 Jun 14 18:02:04.006055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 294/596] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 14 18:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-765269263 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:02:04.239832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:04.253203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-12c33b45-6594-4602-99d6-a0487d85f7d6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.290483 Jun 14 18:02:04.258646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 303/597] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:03 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:04.688951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:04.690601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:04.699504 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:04.700277 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:04.701359 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:04.701978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:04.886020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:04.888307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:04.913189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:04.914487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:04.916297 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:04.917361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.071996 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:05.093341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-92d9b8d0-2b09-4119-b3b4-d6ec0b0ead80 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.408115 Jun 14 18:02:05.123094 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 295/598] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:04 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:05.144113 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:05.145158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:05.162933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:05.163475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.164307 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:05.164752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.166172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:05.176334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2ac1017c-8126-4f45-8be7-6836aefda0d8 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.297956 Jun 14 18:02:05.187373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 304/599] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:04 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:05.193336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-67fffc3d-b954-4029-bfa3-337f5f932eba req-b1e61f74-61d7-4d38-b1b4-c181caa44933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b796fc82-5a9a-4929-af85-b0c291d5c844", "name": "network-vif-plugged", "status": "completed", "tag": "cae630ba-1eae-47ab-82c0-b88adf43f6bd"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:05.202757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-67fffc3d-b954-4029-bfa3-337f5f932eba req-b1e61f74-61d7-4d38-b1b4-c181caa44933 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:05.203654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-67fffc3d-b954-4029-bfa3-337f5f932eba req-b1e61f74-61d7-4d38-b1b4-c181caa44933 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.229734 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-67fffc3d-b954-4029-bfa3-337f5f932eba req-b1e61f74-61d7-4d38-b1b4-c181caa44933 service nova] Creating event network-vif-plugged:cae630ba-1eae-47ab-82c0-b88adf43f6bd for instance b796fc82-5a9a-4929-af85-b0c291d5c844 on hv-cinder-82635 Jun 14 18:02:05.240563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-67fffc3d-b954-4029-bfa3-337f5f932eba req-b1e61f74-61d7-4d38-b1b4-c181caa44933 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050976 Jun 14 18:02:05.242272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 305/600] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:05.252851 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-b1b4be2b-fe93-463a-a460-2156160e3126 req-b8dd1de7-2c15-4a3b-a62d-fc5500ba2248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6af6eeb1-c02d-4f05-b73c-d9b771b348bd", "tag": "7241e328-d5e0-4de1-96f2-7e86c9929ba1"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:05.271772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-b1b4be2b-fe93-463a-a460-2156160e3126 req-b8dd1de7-2c15-4a3b-a62d-fc5500ba2248 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:05.272523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-b1b4be2b-fe93-463a-a460-2156160e3126 req-b8dd1de7-2c15-4a3b-a62d-fc5500ba2248 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.297891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-b1b4be2b-fe93-463a-a460-2156160e3126 req-b8dd1de7-2c15-4a3b-a62d-fc5500ba2248 service nova] Creating event network-changed:7241e328-d5e0-4de1-96f2-7e86c9929ba1 for instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd on hv-cinder-82635 Jun 14 18:02:05.305076 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-b1b4be2b-fe93-463a-a460-2156160e3126 req-b8dd1de7-2c15-4a3b-a62d-fc5500ba2248 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056450 Jun 14 18:02:05.305697 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 306/601] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:05.332586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:05.332586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:05.348044 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:05.348510 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.349313 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:05.349760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:05.469394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:05.495173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a9bbd223-5c90-44e6-b1ab-ef62494ca092 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.369927 Jun 14 18:02:05.502960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 296/602] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:05 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:05.511410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f2f2e8c5-5e7a-4477-b34f-3f1767c1aabf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: .version_select at 0x7fbaeff80b80>, body: {"keypair": {"name": "tempest-keypair-447013395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMR5pgqN9ob4JmmttnibOImoRDBOH6jJhJE1h0taLXEAwTy4SjlzkCnLTfBs89w5Ja0RvLVZwwNH3s66wi/mtV2+VOklPVkdKfDO0x9Xz260P16VqoTKNditNRwdzgOzxA=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:05.556233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-f2f2e8c5-5e7a-4477-b34f-3f1767c1aabf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:02:05.567654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-f2f2e8c5-5e7a-4477-b34f-3f1767c1aabf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:02:05.603904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:05.607044 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-83dbe850-6227-47a1-ae83-81138dd095b5 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.299994 Jun 14 18:02:05.607670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 307/603] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:05 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:05.736598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f2f2e8c5-5e7a-4477-b34f-3f1767c1aabf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.229004 Jun 14 18:02:05.740642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 297/604] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:02:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:06.120524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:06.121781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:06.137205 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.137947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.139075 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.139662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.198756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:06.199714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:06.210099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.210691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.211550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.212001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.343698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:06.352150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b7c55035-6aa2-45a4-a748-9ebc7c0c156b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.240973 Jun 14 18:02:06.352739 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 308/605] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:06 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:06.447112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:06.464742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4529efa1-336a-4fa6-9203-1de59a63ee5a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.271823 Jun 14 18:02:06.466613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 298/606] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:06 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:06.525000 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:06.526016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:06.533892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.534347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.535370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.535965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.635742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:06.636602 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:06.639251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:06.646041 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.646707 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.648232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:06.648797 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:06.701188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:06.712160 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fd6934a5-8bcb-43f8-b9fe-007b6db6bcf9 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.192051 Jun 14 18:02:06.713152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 309/607] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:06 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:06.829158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:06.871944 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:06.886376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1ef704c2-e9fe-43d8-b4f8-98e293a8f3a2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.257139 Jun 14 18:02:06.891607 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 299/608] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:06 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:07.305117 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-ba643bcd-c9c5-45c0-839d-6c120ad91289 req-06c60a1c-505e-4be2-bf18-8c1ea05bf107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4183d50a-65d3-47a0-90bd-ec11efad799a", "name": "network-vif-plugged", "status": "completed", "tag": "1fcab755-2ded-49b3-bc1b-1d3480979cd3"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:07.316541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-ba643bcd-c9c5-45c0-839d-6c120ad91289 req-06c60a1c-505e-4be2-bf18-8c1ea05bf107 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.317053 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-ba643bcd-c9c5-45c0-839d-6c120ad91289 req-06c60a1c-505e-4be2-bf18-8c1ea05bf107 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.333749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-ba643bcd-c9c5-45c0-839d-6c120ad91289 req-06c60a1c-505e-4be2-bf18-8c1ea05bf107 service nova] Creating event network-vif-plugged:1fcab755-2ded-49b3-bc1b-1d3480979cd3 for instance 4183d50a-65d3-47a0-90bd-ec11efad799a on hv-cinder-82635 Jun 14 18:02:07.339551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-ba643bcd-c9c5-45c0-839d-6c120ad91289 req-06c60a1c-505e-4be2-bf18-8c1ea05bf107 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038136 Jun 14 18:02:07.340331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 310/609] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:02:07.375792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:07.376894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:07.383596 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.384045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.384835 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.385268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.485057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:07.485934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:07.491983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:07.495157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.495157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.495796 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.495961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.501438 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:07.674787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:07.685030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-dea44003-5b00-456b-9f1c-e8ba0ac6925e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.204207 Jun 14 18:02:07.688574 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 311/610] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:07 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:07.739178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:07.739828 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:07.753473 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.754269 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.755075 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.755543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.859957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:07.873498 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-96c17dda-873e-4078-8b83-6b9740a45b41 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1314 microversion: 2.1 time: 0.501716 Jun 14 18:02:07.879547 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 300/611] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:07 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:07.939479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:07.940507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:07.964283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:07.967433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.968991 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.972504 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:07.973479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:07.982101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3b82e294-b2d0-4774-9a36-c5dfb463e149 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.248154 Jun 14 18:02:07.983186 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 312/612] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:07 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:08.323345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:08.333854 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4132b7e7-e638-42b6-805b-b86197def283 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.423584 Jun 14 18:02:08.334780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 301/613] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:07 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:08.705515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:08.706852 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:08.715911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:08.716442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:08.717479 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:08.717969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:08.901573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:08.904373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:08.920720 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:08.921855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:08.923628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:08.925102 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:08.974500 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:08.985061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-319155ae-6e37-4a5a-86d4-71fb1baea43e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.284637 Jun 14 18:02:08.986584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 313/614] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:08 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:09.010174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:09.010824 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:09.017820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:09.018277 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:09.019066 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:09.019545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:09.218722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:09.228074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6ce6a01c-93ac-4fc3-84ec-822b0b05e9b3 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.221632 Jun 14 18:02:09.228630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 314/615] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:09 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:09.324160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:09.334141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f815014a-b9ad-4941-9c1f-028c9ae85617 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1498 microversion: 2.1 time: 0.444128 Jun 14 18:02:09.334839 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 302/616] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:08 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1498 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:09.363467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:09.365576 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:09.376541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:09.377780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:09.378708 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:09.379470 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:09.552839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:09.561240 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9345cd81-1e3c-415a-8a87-b84b0c68ca5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.204645 Jun 14 18:02:09.564877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 315/617] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:09 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:10.013301 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:10.013876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:10.023340 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.023916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.024721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.025156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.074517 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1728236066", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0964eb9b-e0dc-493c-8b01-2ac272fdf32e"}], "security_groups": [{"name": "tempest-securitygroup--388988005"}], "key_name": "tempest-keypair-447013395", "user_data": "}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:10.213157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:10.223943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-64f2410c-4d84-4271-97d3-3b3bb04df011 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1678 microversion: 2.1 time: 0.214865 Jun 14 18:02:10.226722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] validate_networks() for [('0964eb9b-e0dc-493c-8b01-2ac272fdf32e', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:02:10.236226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 303/618] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:10 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1678 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:10.250127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:10.252351 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:10.262943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.264204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.265613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.266467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.450087 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:10.459398 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5ea7d1ea-3350-4811-9560-3ddcf2b6c29a tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.215670 Jun 14 18:02:10.460229 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 304/619] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:10 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:10.465321 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:10.465894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:10.473711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.474275 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.475112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.475577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.506185 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:02:10.790732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:02:10.792072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:02:10.793278 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:02:10.794104 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:02:10.794887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:02:10.812152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.812736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.813741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:10.814673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:10.834634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:02:10.839611 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:02:10.854032 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:02:10.856433 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:02:10.995835 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c57e63a1-5cc5-42f4-9331-620f3b5ca759 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 204 len: 0 microversion: 2.1 time: 0.534273 Jun 14 18:02:10.996437 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 305/620] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:02:10 2022] DELETE /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:02:11.002400 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:11.004621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:11.009871 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.010319 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.011109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.011589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.049875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e5b73d21-e006-4715-8594-9232b58f7a8e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.982855 Jun 14 18:02:11.051573 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 316/621] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:02:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:02:11.061179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:11.062422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:11.075266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.076235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.077898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.078663 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.223537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:11.231774 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-66ad35ee-ec2f-4b2c-a085-698b0b8435df tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1372 microversion: 2.1 time: 0.234048 Jun 14 18:02:11.232573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 306/622] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:10 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:11.256861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-eb7d022e-c4a3-47d0-b5d7-312d7d6c3fde tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:11.257801 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-eb7d022e-c4a3-47d0-b5d7-312d7d6c3fde tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:11.295370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:11.307937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9793aeb6-d821-4336-97e8-2ebea60b16ee tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1504 microversion: 2.1 time: 0.254404 Jun 14 18:02:11.308546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 317/623] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:11 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:11.324354 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:11.324979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:11.333229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.333731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.338426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.338426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.338879 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-eb7d022e-c4a3-47d0-b5d7-312d7d6c3fde tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:11.344152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-eb7d022e-c4a3-47d0-b5d7-312d7d6c3fde tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1241 microversion: 2.1 time: 0.110184 Jun 14 18:02:11.344985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 307/624] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:11 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:11.479348 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:11.480319 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:11.488563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.489205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.490694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.491445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.495507 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:11.504422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3692a287-9c78-447f-b70b-85dd775a56c7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1655 microversion: 2.1 time: 0.184187 Jun 14 18:02:11.505295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 318/625] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:11 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1655 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:11.526794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-13fd3e01-2930-4e8b-87e6-4b6c6ce0dffe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:11.534788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-13fd3e01-2930-4e8b-87e6-4b6c6ce0dffe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.535239 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-13fd3e01-2930-4e8b-87e6-4b6c6ce0dffe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.564545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-13fd3e01-2930-4e8b-87e6-4b6c6ce0dffe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Going to try to start instance {{(pid=125161) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 14 18:02:11.664876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:11.674675 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-3d0c3f15-ec96-4e7d-9030-cc6195973c82 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.200279 Jun 14 18:02:11.675250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 308/626] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:11 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:11.817008 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-13fd3e01-2930-4e8b-87e6-4b6c6ce0dffe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action" status: 202 len: 0 microversion: 2.1 time: 0.294373 Jun 14 18:02:11.817653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 319/627] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:02:11 2022] POST /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:02:11.827286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:11.828236 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:11.834958 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.835453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.836258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:11.836762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:11.988941 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:11.997828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e2bab030-3691-4611-8b18-72d78ec039e3 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1664 microversion: 2.1 time: 0.174980 Jun 14 18:02:11.998507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 309/628] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:11 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:12.258610 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:12.259247 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:12.267006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.267709 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.268515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.268956 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.327472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:12.328324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:12.351900 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.352351 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.357684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.357684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.476673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:12.514055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-dffb71c1-175e-47d0-bf27-633e4540c72c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1566 microversion: 2.1 time: 0.259908 Jun 14 18:02:12.515215 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 320/629] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:12 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1566 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:12.525738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:12.528127 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:12.545163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.546318 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.554279 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.554279 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.673164 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:12.681962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:12.688287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d88201a5-9f66-4271-93c9-8eaf933eb3d9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1245 microversion: 2.1 time: 0.169770 Jun 14 18:02:12.690389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 321/630] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:12 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1245 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:12.698732 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:12.699967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:12.701433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f94aa5b0-6c08-481b-a92c-9f54d2e6b90d tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1504 microversion: 2.1 time: 0.378317 Jun 14 18:02:12.702251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 310/631] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:12 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:12.708213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:12.709142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:12.716241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.717003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.718071 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.718784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.729785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.730581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.732814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.732946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.867791 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-69a07f99-ad19-417c-9673-d60bc4f41ec0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175430 Jun 14 18:02:12.868725 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 322/632] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 18:02:12 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:12.892553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-cf152e40-2a55-4613-a76a-a94c40fffc4e req-30f86f65-96ad-4fc4-ab1f-9e9db084cd20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af6eeb1-c02d-4f05-b73c-d9b771b348bd", "name": "network-vif-plugged", "status": "completed", "tag": "7241e328-d5e0-4de1-96f2-7e86c9929ba1"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:12.912246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-cf152e40-2a55-4613-a76a-a94c40fffc4e req-30f86f65-96ad-4fc4-ab1f-9e9db084cd20 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:12.913831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-cf152e40-2a55-4613-a76a-a94c40fffc4e req-30f86f65-96ad-4fc4-ab1f-9e9db084cd20 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:12.943146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-cf152e40-2a55-4613-a76a-a94c40fffc4e req-30f86f65-96ad-4fc4-ab1f-9e9db084cd20 service nova] Creating event network-vif-plugged:7241e328-d5e0-4de1-96f2-7e86c9929ba1 for instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd on hv-cinder-82635 Jun 14 18:02:12.952639 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-cf152e40-2a55-4613-a76a-a94c40fffc4e req-30f86f65-96ad-4fc4-ab1f-9e9db084cd20 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064252 Jun 14 18:02:12.955293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 323/633] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:13.023478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:13.024554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:13.046633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:13.047012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:13.048897 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:13.049813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:13.320477 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:13.326810 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:13.340485 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d37d7964-3315-4cc1-b37c-a76684c87956 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.636567 Jun 14 18:02:13.352200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 311/634] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:12 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:13.679859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:13.697982 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fe178e3d-0a9c-4e33-888d-4928dc908755 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1664 microversion: 2.1 time: 0.683274 Jun 14 18:02:13.701600 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 324/635] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:13 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1664 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:13.737593 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:13.737939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:13.744038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:13.747449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:13.795010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:13.807576 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:13.808660 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:13.810402 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:13.810661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:13.811247 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:13.813079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:13.815826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:14.037117 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:14.060546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-851bc89c-4abd-480c-9ff4-ac0aa7a97057 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1462 microversion: 2.1 time: 0.330865 Jun 14 18:02:14.061855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 325/636] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:13 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1462 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:14.091492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:14.100290 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bb8ab856-d23b-4e74-97e9-419408a8cf41 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1301 microversion: 2.1 time: 0.382865 Jun 14 18:02:14.114815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 312/637] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:13 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1301 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:14.227877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-4bb4ae97-6ce8-4a2e-9b10-35d4690aed52 req-ae3bf05c-59c9-4d83-bbb1-bf9465ea6387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b796fc82-5a9a-4929-af85-b0c291d5c844", "name": "network-vif-deleted", "tag": "cae630ba-1eae-47ab-82c0-b88adf43f6bd"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:14.241297 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-4bb4ae97-6ce8-4a2e-9b10-35d4690aed52 req-ae3bf05c-59c9-4d83-bbb1-bf9465ea6387 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:14.243627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-4bb4ae97-6ce8-4a2e-9b10-35d4690aed52 req-ae3bf05c-59c9-4d83-bbb1-bf9465ea6387 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:14.258294 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-4bb4ae97-6ce8-4a2e-9b10-35d4690aed52 req-ae3bf05c-59c9-4d83-bbb1-bf9465ea6387 service nova] Creating event network-vif-deleted:cae630ba-1eae-47ab-82c0-b88adf43f6bd for instance b796fc82-5a9a-4929-af85-b0c291d5c844 on hv-cinder-82635 Jun 14 18:02:14.267522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-4bb4ae97-6ce8-4a2e-9b10-35d4690aed52 req-ae3bf05c-59c9-4d83-bbb1-bf9465ea6387 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043090 Jun 14 18:02:14.268655 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 326/638] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:14.367570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:14.368519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:14.375769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:14.376255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:14.377490 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:14.377944 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:14.603244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:14.616696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-873ad40a-03fc-46a2-a1ec-212cd8a77a68 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.252676 Jun 14 18:02:14.617787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 313/639] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:14 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:14.727859 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:14.728687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:14.736157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:14.739048 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:14.739048 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:14.739048 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.006102 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:15.015006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9500cca5-273a-46ee-8c0e-66aa1d1f74ec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1664 microversion: 2.1 time: 0.291809 Jun 14 18:02:15.015737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 327/640] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:14 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1664 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:15.081796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:15.082684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:15.094001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.094928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.096185 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.096938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.127191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:15.128363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:15.152837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.155324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.160643 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.163355 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.183993 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.184794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.185558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lazy-loading 'fault' on Instance uuid b796fc82-5a9a-4929-af85-b0c291d5c844 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:15.264903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:15.275814 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1c807a51-336d-48f3-add3-169a8ea0ce23 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1304 microversion: 2.1 time: 0.200060 Jun 14 18:02:15.276917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 314/641] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:15 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1304 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:15.293872 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:15.306544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-25d72398-f377-4fbf-9036-fa17ca37beec tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1299 microversion: 2.1 time: 0.186499 Jun 14 18:02:15.307717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 328/642] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:15 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:15.378877 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-4eecf805-9af0-48cd-98f7-d0e517810eb9 req-74d85f51-5dde-4f5a-9adb-234ead632b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4183d50a-65d3-47a0-90bd-ec11efad799a", "tag": "1fcab755-2ded-49b3-bc1b-1d3480979cd3"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:15.394832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-4eecf805-9af0-48cd-98f7-d0e517810eb9 req-74d85f51-5dde-4f5a-9adb-234ead632b54 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.396015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-4eecf805-9af0-48cd-98f7-d0e517810eb9 req-74d85f51-5dde-4f5a-9adb-234ead632b54 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.418388 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-4eecf805-9af0-48cd-98f7-d0e517810eb9 req-74d85f51-5dde-4f5a-9adb-234ead632b54 service nova] Creating event network-changed:1fcab755-2ded-49b3-bc1b-1d3480979cd3 for instance 4183d50a-65d3-47a0-90bd-ec11efad799a on hv-cinder-82635 Jun 14 18:02:15.427627 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-4eecf805-9af0-48cd-98f7-d0e517810eb9 req-74d85f51-5dde-4f5a-9adb-234ead632b54 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056064 Jun 14 18:02:15.428769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 315/643] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:15.637004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:15.637618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:15.645587 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.646036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.647060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:15.647954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:15.652598 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:15.884049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:15.906498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4f3fa802-91d7-4e5e-b0b2-fca87556281f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1318 microversion: 2.1 time: 0.272202 Jun 14 18:02:15.917835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 329/644] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:15 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:16.040135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:16.041906 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:16.053266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.054035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.055725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.056557 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.297116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:16.300408 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:16.307491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:16.314516 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ad730041-2930-41ed-954e-3b8e4b57437f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1668 microversion: 2.1 time: 0.283260 Jun 14 18:02:16.316940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 316/645] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:16 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:16.327794 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.329902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.330963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:16.331876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:16.333382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.334601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.339174 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.339701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.340805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.341249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.403171 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.403880 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.404621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lazy-loading 'fault' on Instance uuid b796fc82-5a9a-4929-af85-b0c291d5c844 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:16.481970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdef75ae06e47a5a2632acd314d3de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3412103661474550b6c9926648e13ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:16.497185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-78bd11a9-4ef8-40e9-9f15-97892f659326 tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 200 len: 1304 microversion: 2.1 time: 0.205712 Jun 14 18:02:16.498353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 330/646] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:16 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 1304 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:16.562415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:16.571858 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-afe0c919-7398-462d-8dd7-ad7724098aa9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.245175 Jun 14 18:02:16.572665 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 317/647] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:16 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:16.937965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:16.937965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:16.952666 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.954237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:16.956924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:16.958564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.249581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:17.265025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-07abcd03-e9d4-4e2f-afff-0a250fc84bad tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1507 microversion: 2.1 time: 0.342889 Jun 14 18:02:17.265718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 331/648] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:16 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:17.287752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9cfcd11-9e93-4cc0-897c-56a2e55257fa", "device": "/dev/sdb"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:17.289494 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:17.300323 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.300847 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.301959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.302409 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.528465 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:17.529342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] [instance: b796fc82-5a9a-4929-af85-b0c291d5c844] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:17.542805 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.543815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.545659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.546820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.571607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] HTTP exception thrown: Instance b796fc82-5a9a-4929-af85-b0c291d5c844 could not be found. Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Request method failure captured: Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 HTTP/1.1 Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMzSv7571UktpU-_iBzkJim0pcLP7NCL9LO61ptUGzbKlQlsE-ZvJroPfYV-xTKOH84mabKErZ6N6Sr2ajCoJlfwp_sYmlglABlzmlS1IWpj39qFxKRufLIu4vrIR9z4S3DGAoRE-l64ZKWpwQ2kkRdFOtj5bT1NODeS3mXaedbDd1M Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 3412103661474550b6c9926648e13ab6 Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesActionsTest-1687308910 Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:02:17.574998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3412103661474550b6c9926648e13ab6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3412103661474550b6c9926648e13ab6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3412103661474550b6c9926648e13ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3412103661474550b6c9926648e13ab6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesActionsTest-1687308910 Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 3412103661474550b6c9926648e13ab6 Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesActionsTest-1687308910 Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesActionsTest-1687308910-project Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 4fdef75ae06e47a5a2632acd314d3de6 Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesActionsTest-1687308910-project Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance b796fc82-5a9a-4929-af85-b0c291d5c844 could not be found. Jun 14 18:02:17.577926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': 'b796fc82-5a9a-4929-af85-b0c291d5c844'} Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b796fc82-5a9a-4929-af85-b0c291d5c844 could not be found. Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:02:17.580722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b796fc82-5a9a-4929-af85-b0c291d5c844 could not be found. Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b796fc82-5a9a-4929-af85-b0c291d5c844 could not be found. Jun 14 18:02:17.582629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:02:17.584849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] Returning 404 to user: Instance b796fc82-5a9a-4929-af85-b0c291d5c844 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:02:17.584849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1bf56526-887c-4e79-b8df-93bc1475053b tempest-VolumesActionsTest-1687308910 tempest-VolumesActionsTest-1687308910-project] 10.222.0.36 "GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844" status: 404 len: 111 microversion: 2.1 time: 0.056857 Jun 14 18:02:17.595274 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 332/649] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:17 2022] GET /compute/v2.1/servers/b796fc82-5a9a-4929-af85-b0c291d5c844 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:02:17.600538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:17.603782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:17.618035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.618596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.619293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.619837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.833073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:17.862960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b92880ae-8b69-47c7-a3ad-810c50698be0 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.248010 Jun 14 18:02:17.862960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 333/650] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:17 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:17.933893 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-594f792e-5044-46b3-8c48-91030f93aae6 req-15c23334-662e-49a1-a742-96762ff82418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b39a9a6-8711-4f93-9a26-7d1f05e71af8", "tag": "df0f3835-b823-46a5-a3ab-0779d0a8a08b"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:17.948212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-594f792e-5044-46b3-8c48-91030f93aae6 req-15c23334-662e-49a1-a742-96762ff82418 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:17.949001 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-594f792e-5044-46b3-8c48-91030f93aae6 req-15c23334-662e-49a1-a742-96762ff82418 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:17.969258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-594f792e-5044-46b3-8c48-91030f93aae6 req-15c23334-662e-49a1-a742-96762ff82418 service nova] Creating event network-changed:df0f3835-b823-46a5-a3ab-0779d0a8a08b for instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 on hv-cinder-82635 Jun 14 18:02:17.978040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-594f792e-5044-46b3-8c48-91030f93aae6 req-15c23334-662e-49a1-a742-96762ff82418 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052450 Jun 14 18:02:17.979466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 334/651] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:02:18.490678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f1ff8d3b-307d-4a64-94e1-7332ccbf3b50 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "POST /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.208643 Jun 14 18:02:18.492558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 318/652] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:02:17 2022] POST /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd/os-volume_attachments => generated 194 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:18.875508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:18.877514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:18.890075 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:18.891104 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:18.893028 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:18.893922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:19.138704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:19.148011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-820f946c-618b-48e7-9177-bdd2e305f1bf tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.281111 Jun 14 18:02:19.148692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 335/653] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:18 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:20.180725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:20.182149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:20.194594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:20.195428 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:20.196819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:20.197606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:20.388830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:20.398487 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-121abeaf-3195-41f0-bccd-c221ecca4755 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.227150 Jun 14 18:02:20.399081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 319/654] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:20 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:21.417307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:21.417944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:21.420175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:21.420863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:21.426941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:21.428097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:21.428886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:21.429326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:21.584595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:21.592658 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d7fbfa60-8004-4dc1-9fb2-11c89e3b824e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.179710 Jun 14 18:02:21.593319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 336/655] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:21 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:22.611481 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:22.612150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:22.615918 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=12 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:22.621531 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:22.621988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:22.622808 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:22.623250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:22.802431 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:22.810221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9b50c2d3-88e9-4e68-beda-647f169eadc3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.203135 Jun 14 18:02:22.810816 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 320/656] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:22 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:23.829881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:23.830479 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:23.837591 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:23.838058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:23.838838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:23.839277 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:24.002446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:24.011014 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-01571c98-b904-4333-ad80-82d47d018512 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.186179 Jun 14 18:02:24.011723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 337/657] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:23 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:25.040694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:25.043361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:25.057457 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:25.058681 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:25.060230 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:25.061500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:25.269452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:25.279355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0be81b84-a31d-4b8f-b9e1-18fb8e0b3f3e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.251688 Jun 14 18:02:25.280778 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 321/658] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:25 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:26.298793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:26.300288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:26.307532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:26.307992 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:26.308791 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:26.309240 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:26.477718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:26.490026 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4479c713-f719-4e5e-9cf6-1cca388d57d2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.195901 Jun 14 18:02:26.497919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 338/659] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:26 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:27.509679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:27.511289 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:27.520506 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:27.521064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:27.521894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:27.522385 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:27.682123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:27.691750 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-24c3b676-ac0b-4665-9369-8635b05ebdc1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.186906 Jun 14 18:02:27.692555 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 322/660] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:27 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:28.713826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:28.715335 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:28.728345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:28.730334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:28.731330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:28.731825 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:28.926305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-a880e294-6fa0-447c-b99f-e231b09b1100 req-a2d4ea39-2076-43f4-8355-ccb6e66236ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b39a9a6-8711-4f93-9a26-7d1f05e71af8", "name": "network-vif-plugged", "status": "completed", "tag": "df0f3835-b823-46a5-a3ab-0779d0a8a08b"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:28.956214 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a880e294-6fa0-447c-b99f-e231b09b1100 req-a2d4ea39-2076-43f4-8355-ccb6e66236ce service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:28.960313 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a880e294-6fa0-447c-b99f-e231b09b1100 req-a2d4ea39-2076-43f4-8355-ccb6e66236ce service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:28.961153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:28.975761 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e3f80a34-9fc5-428e-867c-cec24df08f01 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.267562 Jun 14 18:02:28.976536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 339/661] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:28 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:29.001832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-a880e294-6fa0-447c-b99f-e231b09b1100 req-a2d4ea39-2076-43f4-8355-ccb6e66236ce service nova] Creating event network-vif-plugged:df0f3835-b823-46a5-a3ab-0779d0a8a08b for instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 on hv-cinder-82635 Jun 14 18:02:29.011856 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-a880e294-6fa0-447c-b99f-e231b09b1100 req-a2d4ea39-2076-43f4-8355-ccb6e66236ce service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086980 Jun 14 18:02:29.019503 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 323/662] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:30.003830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:30.004705 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:30.013350 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:30.020399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:30.020399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:30.020399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:30.240601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:30.259944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4e91485a-b0f8-44e7-a8d3-3d2f2312f314 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.266280 Jun 14 18:02:30.260926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 340/663] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:29 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:31.280621 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:31.282492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:31.291354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:31.292571 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:31.293672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:31.294361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:31.473165 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:31.482325 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8e121812-6485-4626-9e3a-c1a89f0aa772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.207542 Jun 14 18:02:31.483042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 324/664] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:31 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:32.506612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:32.508886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:32.513275 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:32.526006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:32.527014 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:32.528293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:32.529338 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:32.802291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:32.810865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d059de74-f7d2-4c20-a206-ecca2252efa8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.312559 Jun 14 18:02:32.832596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 341/665] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:32 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:33.835266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:33.836137 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:33.845374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:33.846165 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:33.847098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:33.847573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:34.004135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:34.015799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-80604714-8886-4185-8e11-e480dcd2bfe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.188139 Jun 14 18:02:34.017799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 325/666] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:33 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:35.039012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:35.039875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:35.053305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:35.053881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:35.054845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:35.055744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:35.314820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:35.328557 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9baee99a-cdc7-4575-a14d-9aabd5e7717a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1366 microversion: 2.1 time: 0.294560 Jun 14 18:02:35.330763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 342/667] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:35 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:36.364374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:36.365527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:36.378056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:36.378887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:36.380332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:36.381343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:36.576042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:36.585408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-66fc8114-1fd8-4a63-8845-2ee439ff1175 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1556 microversion: 2.1 time: 0.229735 Jun 14 18:02:36.586099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 326/668] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:36 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1556 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:36.606545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:36.607146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:36.619609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:36.620331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:36.622320 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:36.622320 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:36.728011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ace168dc-ad9b-4adb-94ed-e09f3ea04d9c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.128345 Jun 14 18:02:36.729707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 343/669] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 18:02:36 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-interface => generated 284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:38.462295 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-f93eee68-6853-486b-aeab-67117352d58f req-40d742a1-35ee-43fc-9d79-3fa77903f6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b39a9a6-8711-4f93-9a26-7d1f05e71af8", "tag": "df0f3835-b823-46a5-a3ab-0779d0a8a08b"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:38.462295 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:38.469170 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-f93eee68-6853-486b-aeab-67117352d58f req-40d742a1-35ee-43fc-9d79-3fa77903f6ac service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:38.470425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-f93eee68-6853-486b-aeab-67117352d58f req-40d742a1-35ee-43fc-9d79-3fa77903f6ac service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:38.487688 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-f93eee68-6853-486b-aeab-67117352d58f req-40d742a1-35ee-43fc-9d79-3fa77903f6ac service nova] Creating event network-changed:df0f3835-b823-46a5-a3ab-0779d0a8a08b for instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 on hv-cinder-82635 Jun 14 18:02:38.493774 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-f93eee68-6853-486b-aeab-67117352d58f req-40d742a1-35ee-43fc-9d79-3fa77903f6ac service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041084 Jun 14 18:02:38.495254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 327/670] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:39.276720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:39.277829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:39.288723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:39.289221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:39.290083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:39.290537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:39.328837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d44ab8cd-4c54-4965-8529-262ad1ce3c07 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments/bc3fdbbc-5f2a-4675-b632-cc78cf75a680" status: 200 len: 194 microversion: 2.20 time: 0.056299 Jun 14 18:02:39.330142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 344/671] 10.222.0.36 () {60 vars in 1453 bytes} [Tue Jun 14 18:02:39 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments/bc3fdbbc-5f2a-4675-b632-cc78cf75a680 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:02:39.464454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:39.473791 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:39.489164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:39.489672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:39.493060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:39.498192 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:39.691419 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:39.697220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lazy-loading 'services' on Instance uuid 105cfea1-617b-4c5a-b63a-df8eda1907bd {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:40.049991 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c7755b46-701f-48c0-af09-24aa516f85f7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments/bc3fdbbc-5f2a-4675-b632-cc78cf75a680" status: 202 len: 0 microversion: 2.20 time: 0.591364 Jun 14 18:02:40.054629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 328/672] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jun 14 18:02:39 2022] DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments/bc3fdbbc-5f2a-4675-b632-cc78cf75a680 => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:02:40.066400 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:40.067775 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:40.083902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:40.089165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:40.092989 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:40.099661 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:40.193830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d166c892-1a58-4d03-9900-46b1b2937e1f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.132395 Jun 14 18:02:40.214427 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 345/673] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 14 18:02:40 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 14 18:02:41.232747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:41.236149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:41.252632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:41.254002 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:41.254999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:41.255875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:41.318017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-856c1348-71fd-4348-bd11-c4de5f430d68 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094478 Jun 14 18:02:41.318971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 329/674] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 14 18:02:41 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:02:42.332320 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:42.333486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:42.341046 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:42.341810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:42.342612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:42.343057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:42.377443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0b49144d-454b-4398-a0d9-eef2288f77ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050382 Jun 14 18:02:42.378037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 346/675] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 14 18:02:42 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:42.473729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:42.474401 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:42.481200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:42.481645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:42.482430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:42.482867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:42.515149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:02:42.876908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-83d8a59c-fdf9-4300-809d-71b583d064d1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 204 len: 0 microversion: 2.20 time: 0.406425 Jun 14 18:02:42.877613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 330/676] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 14 18:02:42 2022] DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 14 18:02:42.886598 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:42.887209 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:42.895498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:42.895953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:42.896733 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:42.897174 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:42.902225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:02:43.070681 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:43.080470 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:43.082274 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:43.083766 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b92e96d7-3a06-41ff-a6a5-7c9aade30e22 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.201016 Jun 14 18:02:43.084456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 347/677] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:42 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:02:44.013252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:44.013848 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:44.022114 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:44.022556 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:44.023622 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:44.024053 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:44.108019 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:44.109443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:44.120481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:44.121051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:44.121942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:44.122493 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:44.146062 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lazy-loading 'services' on Instance uuid 6af6eeb1-c02d-4f05-b73c-d9b771b348bd {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:44.310413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:44.321963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:44.323662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:44.325049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-20888025-d464-4ccb-8239-f638e70a287a tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.224296 Jun 14 18:02:44.329664 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 348/678] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:44 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:02:44.579414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d0fb28fa-9fdc-40eb-89c9-e772778ee648 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd/os-volume_attachments/f9cfcd11-9e93-4cc0-897c-56a2e55257fa" status: 202 len: 0 microversion: 2.1 time: 0.570185 Jun 14 18:02:44.584109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 331/679] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:02:44 2022] DELETE /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd/os-volume_attachments/f9cfcd11-9e93-4cc0-897c-56a2e55257fa => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:02:45.350395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:45.351908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:45.364371 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:45.365184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:45.370305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:45.370305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:45.604645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:45.617178 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:45.619416 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:45.621193 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-96717cee-4ef9-4cef-9782-ad072f130a78 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1724 microversion: 2.20 time: 0.278150 Jun 14 18:02:45.621948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 349/680] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:45 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:46.524823 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-bf4a7fc0-202f-45f9-89dc-3f07314eaac6 req-30b6778a-9d4a-46c4-92a6-f370b37b6e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "105cfea1-617b-4c5a-b63a-df8eda1907bd", "name": "network-vif-deleted", "tag": "aee7e82a-af79-4a4f-94ac-fb8e2db5a29d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:46.539519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-bf4a7fc0-202f-45f9-89dc-3f07314eaac6 req-30b6778a-9d4a-46c4-92a6-f370b37b6e9f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:46.540157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-bf4a7fc0-202f-45f9-89dc-3f07314eaac6 req-30b6778a-9d4a-46c4-92a6-f370b37b6e9f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:46.554784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-bf4a7fc0-202f-45f9-89dc-3f07314eaac6 req-30b6778a-9d4a-46c4-92a6-f370b37b6e9f service nova] Creating event network-vif-deleted:aee7e82a-af79-4a4f-94ac-fb8e2db5a29d for instance 105cfea1-617b-4c5a-b63a-df8eda1907bd on hv-cinder-82635 Jun 14 18:02:46.561926 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-bf4a7fc0-202f-45f9-89dc-3f07314eaac6 req-30b6778a-9d4a-46c4-92a6-f370b37b6e9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048504 Jun 14 18:02:46.564971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 332/681] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:46.651368 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:46.653738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:46.669542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:46.671183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:46.674458 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:46.675353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:46.815256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:46.837313 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:46.840426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:46.843374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-92adf793-2713-4562-8375-71a5a742654b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1367 microversion: 2.20 time: 0.201818 Jun 14 18:02:46.845213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 350/682] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:46 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:46.848534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:46.849586 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:46.868710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:46.869270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:46.870162 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:46.871015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:46.941365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:02:47.500311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fa3fb19d-88e0-4d6f-940d-aa616b403f31 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 204 len: 0 microversion: 2.1 time: 0.660959 Jun 14 18:02:47.501928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 333/683] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:02:46 2022] DELETE /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 0 bytes in 665 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:02:47.514236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:47.515240 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:47.523647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:47.524249 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:47.525345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:47.525917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:47.740867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:47.763185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-dbcc7000-3059-41cc-9073-c4a5886f24f6 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1513 microversion: 2.1 time: 0.253953 Jun 14 18:02:47.764355 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 351/684] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:47 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1513 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:47.865720 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:47.866743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:47.875228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:47.876256 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:47.877756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:47.878196 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:47.915866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:47.916320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:47.916805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lazy-loading 'fault' on Instance uuid 105cfea1-617b-4c5a-b63a-df8eda1907bd {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:47.989390 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:47.999693 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:48.001276 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:48.002501 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-31eae480-39a3-4f4d-b499-22d1ceb03812 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1372 microversion: 2.20 time: 0.143746 Jun 14 18:02:48.003100 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 334/685] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:47 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:48.793948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:48.795133 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:48.807782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:48.808741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:48.810281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:48.811163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:48.992307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:49.006835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f47589b4-bb46-4771-bc77-fdfbf375ad09 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1513 microversion: 2.1 time: 0.222136 Jun 14 18:02:49.008345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 352/686] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:48 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:49.024849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:49.025638 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:49.033719 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:49.034171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:49.034968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:49.035444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:49.073479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:49.074056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:49.074402 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lazy-loading 'fault' on Instance uuid 105cfea1-617b-4c5a-b63a-df8eda1907bd {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:49.129199 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:49.139606 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:49.142219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:49.143155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7384ea38-42d2-425a-a062-92a3019deecc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 200 len: 1372 microversion: 2.20 time: 0.123281 Jun 14 18:02:49.143770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 335/687] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:49 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:50.029406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:50.033925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:50.038011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:50.038796 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:50.040039 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:50.040785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:50.171672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:50.173558 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:50.192962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:50.193651 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:50.194663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:50.195667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:50.229736 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] HTTP exception thrown: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Request method failure captured: Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd HTTP/1.1 Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxANii8mTGJg1LW6xmfim3cmfSBeWqUfhmqRm80YBkJdKuM1TeBWDCAm4iSlwF1goW7arNgbIMDalvJkPMBFpguTfg2tpW125g3yJokRnoGap9TLEtcrBwWJD-RwCT3m_8e7A3EJBoRdQ4awDjppircXQObG488o_vgzd6H_8kwgcQ Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:02:50.234379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61b2ba814064d7da5702f0f15d1ba0a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 0b64d79cbd27413cb9d6064e7b9c88e7 Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:02:50.238366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '105cfea1-617b-4c5a-b63a-df8eda1907bd'} Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:02:50.240064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:02:50.242828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:50.247652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Returning 404 to user: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:02:50.247652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9afa842b-d293-4278-8d4f-572d21e5213b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 404 len: 111 microversion: 2.20 time: 0.078638 Jun 14 18:02:50.250112 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 336/688] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:50 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 14 18:02:50.257086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-670834f7-f0f6-40f0-aab1-385f779fa7ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '.version_select at 0x7fbafc0db1f0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:50.286469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:50.300677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d33c78a6-3699-4f3b-b40d-345008d6223c tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1513 microversion: 2.1 time: 0.275671 Jun 14 18:02:50.301292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 353/689] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:50 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:02:50.352067 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-670834f7-f0f6-40f0-aab1-385f779fa7ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631504134" status: 204 len: 0 microversion: 2.20 time: 0.098945 Jun 14 18:02:50.355349 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 337/690] 10.222.0.36 () {60 vars in 1261 bytes} [Tue Jun 14 18:02:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631504134 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 18:02:50.389081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-978dcc4b-1e94-40e8-89f9-06932083afa4 req-dc335e25-2e95-46f0-8a0f-e1957a26c7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6af6eeb1-c02d-4f05-b73c-d9b771b348bd", "name": "network-vif-deleted", "tag": "7241e328-d5e0-4de1-96f2-7e86c9929ba1"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:50.402881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-978dcc4b-1e94-40e8-89f9-06932083afa4 req-dc335e25-2e95-46f0-8a0f-e1957a26c7b3 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:50.404273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-978dcc4b-1e94-40e8-89f9-06932083afa4 req-dc335e25-2e95-46f0-8a0f-e1957a26c7b3 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:50.432765 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-978dcc4b-1e94-40e8-89f9-06932083afa4 req-dc335e25-2e95-46f0-8a0f-e1957a26c7b3 service nova] Creating event network-vif-deleted:7241e328-d5e0-4de1-96f2-7e86c9929ba1 for instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd on hv-cinder-82635 Jun 14 18:02:50.443630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-978dcc4b-1e94-40e8-89f9-06932083afa4 req-dc335e25-2e95-46f0-8a0f-e1957a26c7b3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063030 Jun 14 18:02:50.446108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 354/691] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:02:51.330842 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:51.331767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:51.342149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:51.342837 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:51.344742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:51.346821 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:51.424082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:51.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:51.426089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lazy-loading 'fault' on Instance uuid 6af6eeb1-c02d-4f05-b73c-d9b771b348bd {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:02:51.503567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e73368f3ce8a43368b30985898cf7393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a142734eadd40fb908c7bd115c81ee4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:51.512347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8338322c-70c6-4e9a-b427-b77cc4184e5f tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 200 len: 1308 microversion: 2.1 time: 0.187232 Jun 14 18:02:51.512794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 338/692] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:51 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 1308 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:02:51.573670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-436de1ef-908c-43bf-a8e5-87472b68c4e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'create', calling method: .version_select at 0x7fbafc7f3c10>, body: {"keypair": {"name": "tempest-keypair-684080610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwVpSklTqkHNDeFuKXitwGjPVU4uf1tp78p1PejM8DooNgxS+/9NYa41axMSNgoPvVdSAmR+HJfcMWUtDLwiUu/8XH18qhurTJWTeTrXgFjdCEDsAC2thw6po+ywm5IZA=="}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:51.590413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-436de1ef-908c-43bf-a8e5-87472b68c4e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:02:51.596729 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-436de1ef-908c-43bf-a8e5-87472b68c4e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for user 0b64d79cbd27413cb9d6064e7b9c88e7 and project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:02:51.816002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-436de1ef-908c-43bf-a8e5-87472b68c4e5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.246742 Jun 14 18:02:51.816782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 355/693] 10.222.0.36 () {62 vars in 1199 bytes} [Tue Jun 14 18:02:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 249 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 14 18:02:52.534768 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:52.536175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] [instance: 6af6eeb1-c02d-4f05-b73c-d9b771b348bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:52.548208 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:52.549050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:52.550147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:52.550729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:52.568975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] HTTP exception thrown: Instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd could not be found. Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Request method failure captured: Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd HTTP/1.1 Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMyPRDd1vNojb4jAN2kMR2m7bxXLoCEc2XGFUJpkaMNH5Tv56-FlBozyZeb5FVVt2sF-znjDQTMJJWBdvoBkMCQPO9H8wFlrHSr1GGI9LwmFEfiKo3EP6lVX27ECVQMljWij583qNjPdYOL8-Ss5sADDCjCbwgcDWca30RVKql6LTUo Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 5a142734eadd40fb908c7bd115c81ee4 Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesSnapshotTestJSON-765847843 Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:02:52.570752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a142734eadd40fb908c7bd115c81ee4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a142734eadd40fb908c7bd115c81ee4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a142734eadd40fb908c7bd115c81ee4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a142734eadd40fb908c7bd115c81ee4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesSnapshotTestJSON-765847843 Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 5a142734eadd40fb908c7bd115c81ee4 Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-765847843 Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesSnapshotTestJSON-765847843-project Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: e73368f3ce8a43368b30985898cf7393 Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesSnapshotTestJSON-765847843-project Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd could not be found. Jun 14 18:02:52.572311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '6af6eeb1-c02d-4f05-b73c-d9b771b348bd'} Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd could not be found. Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:02:52.573343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd could not be found. Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd could not be found. Jun 14 18:02:52.575921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:02:52.578252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] Returning 404 to user: Instance 6af6eeb1-c02d-4f05-b73c-d9b771b348bd could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:02:52.578252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1d7b9059-ca0e-4285-9494-69695ec24303 tempest-VolumesSnapshotTestJSON-765847843 tempest-VolumesSnapshotTestJSON-765847843-project] 10.222.0.36 "GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd" status: 404 len: 111 microversion: 2.1 time: 0.044317 Jun 14 18:02:52.578252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 339/694] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:02:52 2022] GET /compute/v2.1/servers/6af6eeb1-c02d-4f05-b73c-d9b771b348bd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:02:55.390691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-193752918", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e011f604-6fca-46ed-99f7-5d3a1263dd79"}], "security_groups": [{"name": "tempest-securitygroup--2131195737"}], "key_name": "tempest-keypair-684080610", "user_data": "}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:02:55.522752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] validate_networks() for [('e011f604-6fca-46ed-99f7-5d3a1263dd79', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:02:55.977806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:02:55.978563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:02:55.979496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:02:55.980316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:02:55.981073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:02:55.997838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:55.998609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:56.003482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:56.003482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:56.033381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:02:56.041468 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Getting quotas for user 0b64d79cbd27413cb9d6064e7b9c88e7 and project f61b2ba814064d7da5702f0f15d1ba0a. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:02:56.063035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:02:56.066275 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:02:56.277939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bff8e285-da8a-442f-8ca2-6834eb533a9f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.892437 Jun 14 18:02:56.278625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 356/695] 10.222.0.36 () {62 vars in 1187 bytes} [Tue Jun 14 18:02:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 14 18:02:56.292921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bb2c1e05-19bd-47d8-a72e-9f07c87dfd12 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:56.293526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bb2c1e05-19bd-47d8-a72e-9f07c87dfd12 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:56.370012 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bb2c1e05-19bd-47d8-a72e-9f07c87dfd12 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:56.378792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bb2c1e05-19bd-47d8-a72e-9f07c87dfd12 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:56.380420 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bb2c1e05-19bd-47d8-a72e-9f07c87dfd12 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:56.381542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bb2c1e05-19bd-47d8-a72e-9f07c87dfd12 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1280 microversion: 2.20 time: 0.093482 Jun 14 18:02:56.382454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 340/696] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:56 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:57.403251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:57.404307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:57.412125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:57.412583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:57.413369 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:57.413807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:57.487619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:57.496722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:57.498410 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:57.499736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-763342ac-c93c-4e5d-8174-9ec005226e21 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1284 microversion: 2.20 time: 0.102066 Jun 14 18:02:57.500944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 357/697] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:57 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:58.520222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:58.520973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:58.529684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:58.530225 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:58.531280 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:58.533174 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:58.626931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:58.636437 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:58.638018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:58.639227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cb1c3872-315a-48d4-b2d9-596df48fac3d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1284 microversion: 2.20 time: 0.124490 Jun 14 18:02:58.639836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 341/698] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:58 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:02:59.659150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:02:59.659795 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:02:59.666564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:59.667023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:59.667847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:02:59.668287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:02:59.768011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:59.778087 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:59.779940 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:02:59.781220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-036ebb59-5bff-4e5e-81f4-8bdceaa3a06e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1332 microversion: 2.20 time: 0.126848 Jun 14 18:02:59.782783 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 358/699] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:02:59 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:00.802268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:00.802862 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:00.809815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:00.810270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:00.811055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:00.811530 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:00.932428 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:00.942255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:00.949011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:00.949011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-05929909-b6a5-4362-94f9-9906ef775af9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1338 microversion: 2.20 time: 0.148177 Jun 14 18:03:00.949011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 342/700] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:00 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1338 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:01.968632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:01.970542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:01.982538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:01.983830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:01.985260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:01.985747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:02.203378 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:02.213070 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:02.214806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:02.216208 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-46e78930-63f2-4e2b-a805-f76abe18f8d9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.255375 Jun 14 18:03:02.221061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 359/701] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:01 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:02.292332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-431535d8-da02-4cbc-a9dd-48f6aa982dce req-3d2fd49d-0416-4bca-90f7-5cc36d1a66b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:02.303765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-431535d8-da02-4cbc-a9dd-48f6aa982dce req-3d2fd49d-0416-4bca-90f7-5cc36d1a66b1 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:02.304228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-431535d8-da02-4cbc-a9dd-48f6aa982dce req-3d2fd49d-0416-4bca-90f7-5cc36d1a66b1 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:02.322237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-431535d8-da02-4cbc-a9dd-48f6aa982dce req-3d2fd49d-0416-4bca-90f7-5cc36d1a66b1 service nova] Creating event network-changed:dfae5e13-77b4-4719-a356-b4aed071f325 for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 on hv-cinder-82635 Jun 14 18:03:02.327788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-431535d8-da02-4cbc-a9dd-48f6aa982dce req-3d2fd49d-0416-4bca-90f7-5cc36d1a66b1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041264 Jun 14 18:03:02.329650 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 343/702] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:02.372843 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e6e990c-ab41-403b-88f9-95479a73c3fa"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:02.374071 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:02.381795 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:02.382887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:02.383734 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:02.384184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:03.246132 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:03.247074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:03.254695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:03.255149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:03.256072 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:03.256506 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:03.279548 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:03.435780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:03.446075 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:03.447620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:03.448753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e165cd40-5761-4cd7-90e5-af42e8dcdff7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.207090 Jun 14 18:03:03.449311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 344/703] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:03 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:03.737706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d889dd25-ee87-4e96-80ce-ef08c56bd47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.368889 Jun 14 18:03:03.738347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 360/704] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:03:02 2022] POST /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments => generated 194 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:04.470853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:04.470853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:04.477460 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:04.477914 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:04.478698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:04.479129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:04.646873 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:04.656168 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:04.658128 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:04.659338 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-69640a6b-2bcd-4ce5-93d7-cf95af9f5d8b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.195404 Jun 14 18:03:04.660058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 345/705] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:04 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:03:05.680086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:05.680815 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:05.683997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:05.690350 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:05.690814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:05.693491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:05.693491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:05.834067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:05.842229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:05.843776 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:05.845113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8ecff660-f198-41ce-ab74-b426cb2ee3f6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.170269 Jun 14 18:03:05.845679 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 361/706] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:05 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:06.864584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:06.865187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:06.867869 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:06.874100 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:06.890509 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:06.890509 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:06.890509 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:07.021856 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:07.030469 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:07.033259 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:07.034428 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-357a84e2-ce9a-409e-b022-8a11dfc8baaf tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.174572 Jun 14 18:03:07.035011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 346/707] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:06 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:08.053440 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:08.054053 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:08.055959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:08.056634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=10 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:08.062230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:08.062873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:08.064295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:08.064744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:08.217770 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:08.227317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:08.228886 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:08.230023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-eea21f6a-2c11-462a-9a60-4913c0c56d47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.180547 Jun 14 18:03:08.230633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 362/708] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:08 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:03:09.249223 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:09.249876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:09.256799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:09.257255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:09.258045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:09.258484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:09.418210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:09.428172 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:09.430040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:09.431439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-95bd7f9c-e888-4703-b951-0a63dc0c95df tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.186320 Jun 14 18:03:09.432465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 347/709] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:09 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:10.450102 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:10.450712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:10.458354 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:10.458810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:10.459632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:10.460070 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:10.791539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:10.800091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:10.801613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:10.802743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1cedf293-7e02-48de-9c63-6da7da7b97ac tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.356654 Jun 14 18:03:10.803330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 363/710] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:10 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:11.138630 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-fb51fafe-4dce-4627-922f-c63680c74fbe req-ce3980e5-bf4c-47ed-9580-a8f991aa984b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "name": "network-vif-plugged", "status": "completed", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:11.144632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:11.148813 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-fb51fafe-4dce-4627-922f-c63680c74fbe req-ce3980e5-bf4c-47ed-9580-a8f991aa984b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:11.149251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-fb51fafe-4dce-4627-922f-c63680c74fbe req-ce3980e5-bf4c-47ed-9580-a8f991aa984b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:11.161303 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-fb51fafe-4dce-4627-922f-c63680c74fbe req-ce3980e5-bf4c-47ed-9580-a8f991aa984b service nova] Creating event network-vif-plugged:dfae5e13-77b4-4719-a356-b4aed071f325 for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 on hv-cinder-82635 Jun 14 18:03:11.166109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-fb51fafe-4dce-4627-922f-c63680c74fbe req-ce3980e5-bf4c-47ed-9580-a8f991aa984b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Jun 14 18:03:11.166731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 348/711] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:11.822272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:11.822834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:11.832768 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:11.832768 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:11.833108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:11.833695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:11.976509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:11.979910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:11.984987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:11.986663 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:11.987806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-581a514e-7764-481a-90d7-15200b2cb21c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.169695 Jun 14 18:03:11.988360 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 364/712] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:11 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:13.009226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:13.009971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:13.016797 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:13.017258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:13.018198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:13.018637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:13.224150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:13.232343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:13.233819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:13.234918 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2e2c5df0-3997-4fce-9369-eecd2ca16da9 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1406 microversion: 2.20 time: 0.231138 Jun 14 18:03:13.236324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 349/713] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:13 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:14.254644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:14.255310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:14.262456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:14.262930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:14.263723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:14.264293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:14.406483 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:14.415524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:14.417040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:14.418236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0abae464-0ca2-42d5-ada2-2777949d5873 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1599 microversion: 2.20 time: 0.168881 Jun 14 18:03:14.418798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 365/714] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:03:14 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:03:14.436927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:14.437508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:14.444747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:14.445236 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:14.445936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:14.446377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:14.527525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-041dc5fa-579d-46f7-9a48-1028b8de2570 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094484 Jun 14 18:03:14.528136 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 350/715] 10.222.0.36 () {60 vars in 1315 bytes} [Tue Jun 14 18:03:14 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:03:14.827470 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:14.828529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:14.835843 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:14.836300 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:14.837082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:14.837528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:14.864830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'flavor' on Instance uuid 4183d50a-65d3-47a0-90bd-ec11efad799a {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:03:15.371448 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e5bd42e9-ab30-45da-880d-2bdb0566d1a4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/action" status: 200 len: 32 microversion: 2.1 time: 0.548245 Jun 14 18:03:15.372801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 366/716] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:03:14 2022] POST /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/action => generated 32 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:03:15.384714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:15.385717 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:15.393090 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:15.393922 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:15.395089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:15.395935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:15.860504 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:15.869206 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-14c1ce97-f004-4322-b379-24be5a93ba92 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.490324 Jun 14 18:03:15.870723 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 351/717] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:15 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:16.010833 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-93baa012-f6a5-47e2-91f0-2114d782d308 req-7181996e-e493-4944-a433-09ecf3de516f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:16.022590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-93baa012-f6a5-47e2-91f0-2114d782d308 req-7181996e-e493-4944-a433-09ecf3de516f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:16.023036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-93baa012-f6a5-47e2-91f0-2114d782d308 req-7181996e-e493-4944-a433-09ecf3de516f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:16.034870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-93baa012-f6a5-47e2-91f0-2114d782d308 req-7181996e-e493-4944-a433-09ecf3de516f service nova] Creating event network-changed:dfae5e13-77b4-4719-a356-b4aed071f325 for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 on hv-cinder-82635 Jun 14 18:03:16.040407 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-93baa012-f6a5-47e2-91f0-2114d782d308 req-7181996e-e493-4944-a433-09ecf3de516f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035847 Jun 14 18:03:16.041045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 367/718] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:16.888328 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:16.888758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:16.896537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:16.896997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:16.897786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:16.898250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:17.042507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:17.053467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fe8a4f1e-731d-4204-a6d0-83fc439063d0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.169479 Jun 14 18:03:17.054048 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 352/719] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:16 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:18.072983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:18.073699 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:18.080931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:18.081172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:18.081949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:18.082381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:18.234526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:18.244462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e9819dfa-ac4f-4f4e-85f6-7bb06c1224f9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.176172 Jun 14 18:03:18.245283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 368/720] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:18 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:19.263520 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:19.264138 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:19.271936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:19.272394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:19.273179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:19.273618 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:19.421043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:19.431698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2288e6c5-d97d-46de-b9f4-4ef093b49ad0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.172020 Jun 14 18:03:19.432341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 353/721] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:19 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:20.333062 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:20.334036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:20.340614 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.341115 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.341895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.342327 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.374095 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-19075594-c937-400f-b6df-94e9d3a34525 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045702 Jun 14 18:03:20.374854 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 369/722] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:03:20 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:03:20.437047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:20.437681 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:20.445286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.445659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.446459 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.446900 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.449020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:20.449698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:20.457195 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.457498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.458344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.458788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.474811 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:03:20.600451 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:20.609220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6d9a29d6-2107-4a97-a2ed-24b3f8b30e7e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.164196 Jun 14 18:03:20.610271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 370/723] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:20 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:20.887175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-af3137b0-cf2d-4cb2-a018-81b0496e8323 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 204 len: 0 microversion: 2.1 time: 0.453978 Jun 14 18:03:20.887599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 354/724] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:03:20 2022] DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:03:20.895975 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:20.900343 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:20.903003 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.903496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:20.904271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:20.904713 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:21.056501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:21.065849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1ff881d6-6f20-424a-bad7-6fdd6d335c48 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1674 microversion: 2.1 time: 0.173688 Jun 14 18:03:21.066909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 371/725] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:20 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:21.626807 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:21.627478 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:21.634101 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:21.634555 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:21.635350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:21.635792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:21.774019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:21.782691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-404a3a79-deaf-4626-8aeb-534cb2071e66 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.159591 Jun 14 18:03:21.783251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 355/726] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:21 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:22.084405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:22.085064 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:22.092191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:22.092653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:22.093652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:22.094089 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:22.245430 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:22.253915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9e3ec07d-34e0-4d70-ab32-2c8ba09933d1 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1674 microversion: 2.1 time: 0.174731 Jun 14 18:03:22.254532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 372/727] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:22 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:22.805094 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:22.805840 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:22.818999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:22.819849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:22.821133 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:22.822082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:23.002866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:23.012786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c44311b1-3561-4b7f-97a7-df57e5a2ca09 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.215950 Jun 14 18:03:23.022801 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 356/728] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:22 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:23.272196 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:23.274300 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:23.281427 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:23.282965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:23.283776 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:23.284433 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:23.585051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:23.592753 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9ea89a49-d1a1-47b6-8c42-6a9ec0bd7cbd tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1674 microversion: 2.1 time: 0.324619 Jun 14 18:03:23.593361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 373/729] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:23 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1674 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:24.030330 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:24.030999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:24.037571 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.038024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.039009 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.039484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.210354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:24.226405 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c91b57a4-11b7-466e-b00e-14e39f2895b6 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.199431 Jun 14 18:03:24.232048 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 357/730] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:24 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:24.466957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-155836aa-e38c-4962-9b9f-db61f1cdd042 req-193a6882-6130-469c-953c-d1a3ed087012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2412cb1-a36e-4e84-92d7-ca0c179b6993", "name": "network-vif-deleted", "tag": "c319c807-d07b-43be-a8ee-999e7a34ee23"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:24.475929 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-155836aa-e38c-4962-9b9f-db61f1cdd042 req-193a6882-6130-469c-953c-d1a3ed087012 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.476373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-155836aa-e38c-4962-9b9f-db61f1cdd042 req-193a6882-6130-469c-953c-d1a3ed087012 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.490232 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-155836aa-e38c-4962-9b9f-db61f1cdd042 req-193a6882-6130-469c-953c-d1a3ed087012 service nova] Creating event network-vif-deleted:c319c807-d07b-43be-a8ee-999e7a34ee23 for instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 on hv-cinder-82635 Jun 14 18:03:24.499746 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-155836aa-e38c-4962-9b9f-db61f1cdd042 req-193a6882-6130-469c-953c-d1a3ed087012 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036336 Jun 14 18:03:24.503964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 374/731] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:24.615952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:24.617661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:24.629003 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.629864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.631179 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.632200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.720702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:24.729944 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bf87e343-8814-4cb8-b252-1cae3391cba5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1607 microversion: 2.1 time: 0.121276 Jun 14 18:03:24.731682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 358/732] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:24 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1607 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:24.805615 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:24.806330 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:24.815952 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.816919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.818268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:24.819813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:24.849578 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lazy-loading 'flavor' on Instance uuid 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:03:25.162187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-31d1b8d8-77c9-4028-9d0d-22186b804ecb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "POST /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9/action" status: 202 len: 0 microversion: 2.1 time: 0.362706 Jun 14 18:03:25.162187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 375/733] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:03:24 2022] POST /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:03:25.170442 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:25.171152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:25.179037 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:25.179817 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:25.180615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:25.181049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:25.248426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:25.249552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:25.257448 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:25.258415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:25.259949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:25.259949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:25.356950 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:25.372338 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f06412d0-1669-4a11-9d72-a7baf78e26eb tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.206014 Jun 14 18:03:25.373585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 359/734] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:25 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:25.421676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:25.430336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-398e2d8c-f74f-44b0-937b-200d6f0692af tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.187934 Jun 14 18:03:25.430935 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 376/735] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:25 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:25.749683 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:25.750287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:25.757154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:25.757598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:25.758363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:25.758793 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:25.778724 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:25.825401 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:25.834026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9a72eed6-12b2-40fe-a8c8-1f4a9b6db3ff tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1607 microversion: 2.1 time: 0.088176 Jun 14 18:03:25.834605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 360/736] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:25 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:26.271394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:26.271987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:26.278770 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.279219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.280116 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.280546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.306352 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2c484867-6e3b-48ec-9d63-87914dbaf281 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/ips" status: 200 len: 149 microversion: 2.1 time: 0.040176 Jun 14 18:03:26.306982 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 377/737] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 18:03:26 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:26.401299 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:26.402710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:26.410363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.410902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.411724 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.412177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.449197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:26.449874 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:26.457395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.458118 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.458904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.459371 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.574742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:26.584501 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-49948d7c-3cef-44b1-96c0-8e9341272589 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.189775 Jun 14 18:03:26.585091 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 361/738] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:26 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:26.598913 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:26.607259 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c4f5e9d6-4d37-40f0-8940-7d8ad90729b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.162489 Jun 14 18:03:26.607863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 378/739] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:26 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:26.852512 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:26.853121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:26.860204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.861149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.862068 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.862399 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.895017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:26.895539 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:26.896002 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lazy-loading 'fault' on Instance uuid d2412cb1-a36e-4e84-92d7-ca0c179b6993 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:03:26.997156 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:27.012628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-51f7a796-addd-4320-9a14-8165a9e54a67 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 200 len: 1327 microversion: 2.1 time: 0.163443 Jun 14 18:03:27.023158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 362/740] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:26 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:27.601873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:27.602498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:27.609822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:27.610287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:27.611147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:27.611618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:27.616636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:27.627755 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:27.629210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:27.636919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:27.637376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:27.638330 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:27.638695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:27.779175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:27.790846 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9b127323-042e-468b-9894-5dc573f02ad2 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.192788 Jun 14 18:03:27.791652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 379/741] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:27 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:27.808421 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:27.818101 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c54f9a1e-d9dd-43d4-a750-27cb7fcb7638 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.195865 Jun 14 18:03:27.818676 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 363/742] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:27 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:28.032180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:28.032180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:28.039233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:28.039726 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:28.040506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:28.040948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:28.056952 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] HTTP exception thrown: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Request method failure captured: Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 HTTP/1.1 Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxGwE3GxoWdy0dEFNY8aUqh0fZdeZ7I55cz8wRNMuNvCZesew3JDksY-zklRIMORK_DPNLaTRorfMySeR_qfWKqGxua-V5sMS1M8X_PziCNLG90x7rQjqorklBST4_5I7CDNAyogMdNM_XBEhPLMt6koVkFgpp-FEkwQ2USyERgwnk Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:03:28.058752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2bf6c7727884fd98fd7035f04de2da5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 41680577c34d4b9090270d3097a7e02c Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:03:28.060375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': 'd2412cb1-a36e-4e84-92d7-ca0c179b6993'} Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:03:28.061230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:03:28.062564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:28.064349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Returning 404 to user: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:03:28.064349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-73e1c010-bf36-4c90-8b94-ed5a9763eb69 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 404 len: 111 microversion: 2.1 time: 0.033715 Jun 14 18:03:28.064349 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 380/743] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:28 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:03:28.070358 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f7186c2c-2c13-43d4-9e61-cc53ad43a3bb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '.version_select at 0x7fbafc0e1ee0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:28.168232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f7186c2c-2c13-43d4-9e61-cc53ad43a3bb tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006205685" status: 202 len: 0 microversion: 2.1 time: 0.101619 Jun 14 18:03:28.168832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 364/744] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 14 18:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006205685 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:03:28.300144 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "795b412e-f5d1-4e9b-b3dd-3a1c672952b0"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:28.303897 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:28.309126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:28.309905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:28.311326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:28.312108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:28.809977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:28.810572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:28.817655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:28.820085 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:28.820085 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:28.820085 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:29.003499 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:29.011346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fb503ac0-ab9b-4a3d-a368-e3779f23dac1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.205842 Jun 14 18:03:29.011933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 365/745] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:28 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:29.016566 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:29.018142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:29.024598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:29.025049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:29.025838 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:29.026267 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:29.177075 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:29.184228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6603f2d2-3684-4049-ac4f-fd30c8df236b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.171214 Jun 14 18:03:29.184803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 366/746] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:29 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:29.273411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-530285be-5ccf-412d-83f0-1467b7e66fc5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: .version_select at 0x7fbaeffb7430>, body: {"keypair": {"name": "tempest-keypair-1459676628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/+LjPisUks/k4F6HGXvYD5MVIDplOR/13ZbxNIzrGCOtjNZFeSKttUJ0bHXl2/whgrZMQVMq7zdGmQbK+0r2GUqZrWYxm4sjmlyhGcNx2O+owz2ko3flTq1YHcnNlUqw=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:29.284412 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-351ac28b-ea84-45d2-a2ec-fde24ea4a426 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.989178 Jun 14 18:03:29.288147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 381/747] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:03:28 2022] POST /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:29.288819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-530285be-5ccf-412d-83f0-1467b7e66fc5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:03:29.292982 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-530285be-5ccf-412d-83f0-1467b7e66fc5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for user 41680577c34d4b9090270d3097a7e02c and project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:03:29.436197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-530285be-5ccf-412d-83f0-1467b7e66fc5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.166901 Jun 14 18:03:29.436802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 367/748] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:03:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:30.031222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:30.031888 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:30.040148 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:30.040660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:30.041462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:30.041937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:30.211043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:30.211782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:30.218346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:30.218888 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:30.219776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:30.220712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:30.228936 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:30.237723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-17180604-cba9-410b-a3b5-b96ea8169e13 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.210959 Jun 14 18:03:30.238306 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 382/749] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:30 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:30.357743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:30.366909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f0becfc6-d4b2-4883-9b8b-c9f64fcc9b14 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.160162 Jun 14 18:03:30.367809 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 368/750] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:30 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:31.254324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:31.255096 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:31.265187 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:31.266273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:31.269644 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:31.270512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:31.386894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:31.387787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:31.395696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:31.396154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:31.396943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:31.397466 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:31.547802 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:31.566492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0d783cad-67c1-4e3d-819c-fcf84a2db1f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.306635 Jun 14 18:03:31.566492 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 383/751] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:31 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:31.566742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:31.573796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b95ce494-9ee8-47a0-bc6b-7d75a417d736 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.192013 Jun 14 18:03:31.574381 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 369/752] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:31 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:32.576542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:32.577191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:32.585521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:32.585521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:32.586325 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:32.586914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:32.594134 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:32.596488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:32.604320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:32.605140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:32.606098 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:32.606686 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:32.751129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:32.759671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6e47f6d8-0609-41fc-9df3-92b810117547 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.170493 Jun 14 18:03:32.760252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 370/753] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:32 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:32.765114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:32.775336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5b848a88-8cea-4ab5-b96a-d1f0cd27993a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.203363 Jun 14 18:03:32.776106 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 384/754] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:32 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:32.890552 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2081499582", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e0e0d91-14bd-4c5d-9db2-a2d04d1c9f93"}], "security_groups": [{"name": "tempest-securitygroup--1898189078"}], "key_name": "tempest-keypair-1459676628", "user_data": "}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:33.013140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] validate_networks() for [('3e0e0d91-14bd-4c5d-9db2-a2d04d1c9f93', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:03:33.445880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:03:33.446441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:03:33.446833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:03:33.447273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:03:33.454167 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:03:33.457322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:33.457776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:33.458577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:33.459043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:33.477529 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:03:33.483646 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Getting quotas for user 41680577c34d4b9090270d3097a7e02c and project b2bf6c7727884fd98fd7035f04de2da5. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:03:33.508663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:03:33.511352 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:03:33.638360 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f85484fb-7468-4974-bbc7-aec12ad94d9f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.876979 Jun 14 18:03:33.639101 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 371/755] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:03:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:03:33.650213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e9ba0426-f161-43f5-8730-8d7776ebc792 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:33.650777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e9ba0426-f161-43f5-8730-8d7776ebc792 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:33.714884 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e9ba0426-f161-43f5-8730-8d7776ebc792 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:33.723617 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e9ba0426-f161-43f5-8730-8d7776ebc792 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1238 microversion: 2.1 time: 0.077529 Jun 14 18:03:33.733364 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 385/756] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:33 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:33.780436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:33.781059 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:33.790219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:33.790679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:33.791499 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:33.791931 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:33.795544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:33.796098 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:33.804904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:33.805407 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:33.806190 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:33.806846 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:33.996705 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:34.006766 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:34.017034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-090f9473-fe68-4a52-9e48-356801eee496 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.242730 Jun 14 18:03:34.018043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-38b0fba1-7fbc-4a52-a5b5-916beaccb7ab tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.226255 Jun 14 18:03:34.018820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 386/757] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:33 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:34.019292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 372/758] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:33 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:34.740715 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3bf1bedc-a493-4ae8-b436-93c456e5ca54 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:34.741316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3bf1bedc-a493-4ae8-b436-93c456e5ca54 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:34.806627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3bf1bedc-a493-4ae8-b436-93c456e5ca54 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:34.813646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3bf1bedc-a493-4ae8-b436-93c456e5ca54 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1238 microversion: 2.1 time: 0.076953 Jun 14 18:03:34.815423 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 387/759] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:34 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:35.042432 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:35.043021 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:35.043823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:35.044663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:35.053257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:35.053811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:35.055313 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:35.056025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:35.056631 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:35.057220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:35.058157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:35.058758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:35.231578 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:35.246261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-077b095f-7de0-4d6d-bf58-ad2385574ca2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.208090 Jun 14 18:03:35.246743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 373/760] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:35 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:35.281948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:35.291258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3a0f6235-8f03-4619-8d56-933b9efbb62b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.252973 Jun 14 18:03:35.291865 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 388/761] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:35 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:35.832541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:35.833095 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:35.839533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:35.839999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:35.840782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:35.841221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:35.906175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:35.914767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d0a12764-60cb-4bea-a6e2-277ab08ffd4f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1290 microversion: 2.1 time: 0.086555 Jun 14 18:03:35.915373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 374/762] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:35 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:36.263924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:36.264556 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:36.269390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=60 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:36.272983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:36.273480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:36.274631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:36.274933 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:36.310554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:36.311337 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:36.319388 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:36.319869 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:36.321625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:36.321625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:36.417293 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:36.427002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b448e229-ca95-4110-9f0a-e90ed6980e08 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1737 microversion: 2.1 time: 0.167102 Jun 14 18:03:36.436577 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 389/763] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:36 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:36.470491 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:36.479344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f31a077f-8779-4ee4-a257-b2eaef287b2c tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.172709 Jun 14 18:03:36.480763 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 375/764] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:36 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:36.931915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:36.932514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:36.938581 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:36.940040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:36.940801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:36.941232 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.007758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:37.015272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cf728010-1c3a-4272-8e1b-1719999b5829 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1290 microversion: 2.1 time: 0.087414 Jun 14 18:03:37.015869 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 390/765] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:36 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:37.444904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:37.445506 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:37.452034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.452481 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.453243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.453679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.497198 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:37.497820 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:37.505909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.506432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.507241 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.507707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.602982 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:37.613575 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-97e3e292-4dae-45ad-b963-5f3f0dd17bae tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1717 microversion: 2.1 time: 0.172224 Jun 14 18:03:37.614205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 376/766] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:37 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1717 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:37.710090 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:37.718559 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e163671c-e11e-447f-8b94-1e3606eedd0b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.225003 Jun 14 18:03:37.719146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 391/767] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:37 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:37.769020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:37.769501 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:37.776567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.776933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.777779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.778146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.874789 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] HTTP exception thrown: Cannot 'detach_volume' instance 4183d50a-65d3-47a0-90bd-ec11efad799a while it is in vm_state rescued Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Request method failure captured: Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments/9e6e990c-ab41-403b-88f9-95479a73c3fa HTTP/1.1 Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMyHLiL1wgrsiN0IALwIB4DiL_rl1UCmi-mg2SERiVU3VMVMy7zNiUbUrXqjqZ3WRs7mhLCSO8GKIZC3cA0QzEfx0dCwlnpTIafOAa8zSgTD4QtSNe95msCXz_IoL1RbsqCbvKVme-IuW41_QR75o-uPfVO4F9pp7HThPvEm3xEdHqc Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:03:37.876852 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c8e2494e0744c778b32f979005ec7ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 7f214333671e4878bf613c26ceb1381a Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:03:37.886702 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Cannot 'detach_volume' instance 4183d50a-65d3-47a0-90bd-ec11efad799a while it is in vm_state rescued Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'server_id': '4183d50a-65d3-47a0-90bd-ec11efad799a', 'id': '9e6e990c-ab41-403b-88f9-95479a73c3fa'} Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:03:37.887468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4183d50a-65d3-47a0-90bd-ec11efad799a while it is in vm_state rescued Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4183d50a-65d3-47a0-90bd-ec11efad799a while it is in vm_state rescued Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:37.888742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Returning 409 to user: Cannot 'detach_volume' instance 4183d50a-65d3-47a0-90bd-ec11efad799a while it is in vm_state rescued {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:03:37.889739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6618392e-3e6a-447e-acec-70521bfd234e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments/9e6e990c-ab41-403b-88f9-95479a73c3fa" status: 409 len: 152 microversion: 2.1 time: 0.114178 Jun 14 18:03:37.889739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 377/768] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:03:37 2022] DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments/9e6e990c-ab41-403b-88f9-95479a73c3fa => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 14 18:03:37.894432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:37.894969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:37.908778 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.909390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:37.910179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:37.910611 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.034027 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:38.035656 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:38.043067 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.043625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.044115 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.044877 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.120866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:38.129581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e24421a0-4cb8-455c-a044-80870df2388d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1298 microversion: 2.1 time: 0.099738 Jun 14 18:03:38.130160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 378/769] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:38 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1298 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:38.239195 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3e622ff0-5c51-4ac0-b114-a8893457091e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "POST /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/action" status: 202 len: 0 microversion: 2.1 time: 0.350490 Jun 14 18:03:38.239992 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 392/770] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:03:37 2022] POST /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:03:38.248390 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:38.249063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:38.256534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.257136 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.258010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.258456 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.279095 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:38.395883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:38.404792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b79fcdfc-67b1-429a-b89e-51ce7d282061 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1725 microversion: 2.1 time: 0.160279 Jun 14 18:03:38.405392 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 379/771] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:38 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:38.738717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:38.739456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:38.745776 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.746234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.747003 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.747486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.887225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:38.896450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a1bebb78-6ba5-4342-80e4-e5f5e1b17768 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.162714 Jun 14 18:03:38.897029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 393/772] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:38 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:38.969049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "795b412e-f5d1-4e9b-b3dd-3a1c672952b0"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:38.970368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:38.973926 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:38.980542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.985903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:38.985903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:38.985903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.070230 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Invalid volume: volume 795b412e-f5d1-4e9b-b3dd-3a1c672952b0 is already attached to instances: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: POST /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments HTTP/1.1 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 74 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:03:39.072064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {"volumeAttachment": {"volumeId": "795b412e-f5d1-4e9b-b3dd-3a1c672952b0"}} Jun 14 18:03:39.073603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Invalid volume: volume 795b412e-f5d1-4e9b-b3dd-3a1c672952b0 is already attached to instances: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'server_id': '4b39a9a6-8711-4f93-9a26-7d1f05e71af8', 'body': {'volumeAttachment': {'volumeId': '795b412e-f5d1-4e9b-b3dd-3a1c672952b0'}}} Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 795b412e-f5d1-4e9b-b3dd-3a1c672952b0 is already attached to instances: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:39.074511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 795b412e-f5d1-4e9b-b3dd-3a1c672952b0 is already attached to instances: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:39.075909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 795b412e-f5d1-4e9b-b3dd-3a1c672952b0 is already attached to instances: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 400 to user: Invalid volume: volume 795b412e-f5d1-4e9b-b3dd-3a1c672952b0 is already attached to instances: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-af68c8fe-a31e-4135-bfc8-825099f3897a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108834 Jun 14 18:03:39.077302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 380/773] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:03:38 2022] POST /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:03:39.134468 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:39.134962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:39.141142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.141672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.142971 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.143456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.147071 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:39.147722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:39.154229 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.154679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.155483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.155921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.227293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:39.228528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'services' on Instance uuid 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:03:39.234770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ffafdc2e-8752-4fa1-b91c-a97df8db4629 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1298 microversion: 2.1 time: 0.092748 Jun 14 18:03:39.235365 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 381/774] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:39 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:39.424137 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:39.424756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:39.430820 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.431260 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.432058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.432493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.490292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-257c4ced-8c58-47d8-b2f9-cbfc304e4487 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments/795b412e-f5d1-4e9b-b3dd-3a1c672952b0" status: 202 len: 0 microversion: 2.1 time: 0.359394 Jun 14 18:03:39.490891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 394/775] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:03:39 2022] DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments/795b412e-f5d1-4e9b-b3dd-3a1c672952b0 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:03:39.499781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:39.500883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:39.507871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.508323 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.509099 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.509538 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.527271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:39.541037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3f40c9cc-3f1d-4a3e-8cbf-71f204cba340 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Jun 14 18:03:39.541606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 395/776] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:03:39 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:39.569211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:39.577788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c0ca39d3-570c-4567-8e0a-35f0365b7dd3 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1725 microversion: 2.1 time: 0.158382 Jun 14 18:03:39.578652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 382/777] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:39 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:39.915239 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:39.915924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:39.923786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.924245 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:39.925024 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:39.925582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.066280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:40.075035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-32f5613a-88e0-423c-9795-758a5ea7227a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.163649 Jun 14 18:03:40.075646 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 396/778] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:39 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:40.252480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:40.253242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:40.259692 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:40.260142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.260912 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:40.261348 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.326076 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:40.336324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-96068399-2dc8-4d18-bc1c-5391b2937fec tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1298 microversion: 2.1 time: 0.088236 Jun 14 18:03:40.336914 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 383/779] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:40 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:40.553623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:40.554614 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:40.560783 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:40.561232 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.562003 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:40.562440 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.594472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bee1efe2-86c0-4b87-a7bb-1e2bbf79d973 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Jun 14 18:03:40.595720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 397/780] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:03:40 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:40.597165 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:40.597783 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:40.604401 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:40.604853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.605630 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:40.606101 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:40.751172 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:40.809072 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-894536c7-484a-4acc-b1e9-4b48e643a83b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1725 microversion: 2.1 time: 0.216071 Jun 14 18:03:40.813737 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 384/781] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:40 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:41.093788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:41.094405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:41.103346 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.104310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.105858 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.106660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.284490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:41.293078 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f6b908a8-48d7-4bc3-9fc1-893eaf28a64b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.203483 Jun 14 18:03:41.293995 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 398/782] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:41 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:41.356543 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:41.357208 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:41.366157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.366629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.367582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.368236 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.448427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:41.460019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-808c0815-81a2-450a-9cf3-4b452ea56c21 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1296 microversion: 2.1 time: 0.109156 Jun 14 18:03:41.462845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 385/783] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:41 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:41.609627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:41.612306 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:41.621771 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.621771 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.622543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.623369 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.662326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9c98e619-a55a-4dd2-a844-71b604280ed9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058760 Jun 14 18:03:41.663593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 399/784] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:03:41 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:41.838439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:41.839666 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:41.870963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.871456 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:41.880915 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:41.883723 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.235631 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:42.245802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-08f1f9f4-1dbe-417d-9940-baa4acd0c14e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1725 microversion: 2.1 time: 0.411119 Jun 14 18:03:42.246983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 386/785] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:41 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1725 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:42.310001 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:42.310730 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:42.318028 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:42.318583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.319548 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:42.319949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.460809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:42.469832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3afd56c7-9cc7-4b5d-84c3-3424127b6508 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.163613 Jun 14 18:03:42.477892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 400/786] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:42 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:42.484233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:42.485291 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:42.496074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:42.496595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.498682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:42.499645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.677276 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:42.678339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:42.684724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:42.685183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.685961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:42.686225 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:42.686452 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:42.695875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a0dee2c3-3f07-4c19-a9e0-7672f8a2337f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.216730 Jun 14 18:03:42.696471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 387/787] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:42 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:42.721435 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-78e82621-d9c1-4093-92a7-9428fb2f5c0e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048761 Jun 14 18:03:42.722020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 401/788] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:03:42 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:43.115684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-a2be0f81-eb14-4f57-bb77-6f83bfd0b33d req-9c84c0ec-381b-4e67-a774-447be42ca91c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7de29b-12b3-439a-a994-5eada188817d", "tag": "2d358ed7-706f-4cd0-a87a-d21304bfb6b6"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:43.124161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a2be0f81-eb14-4f57-bb77-6f83bfd0b33d req-9c84c0ec-381b-4e67-a774-447be42ca91c service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.124827 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a2be0f81-eb14-4f57-bb77-6f83bfd0b33d req-9c84c0ec-381b-4e67-a774-447be42ca91c service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.139452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-a2be0f81-eb14-4f57-bb77-6f83bfd0b33d req-9c84c0ec-381b-4e67-a774-447be42ca91c service nova] Creating event network-changed:2d358ed7-706f-4cd0-a87a-d21304bfb6b6 for instance 1c7de29b-12b3-439a-a994-5eada188817d on hv-cinder-82635 Jun 14 18:03:43.146488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-a2be0f81-eb14-4f57-bb77-6f83bfd0b33d req-9c84c0ec-381b-4e67-a774-447be42ca91c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035238 Jun 14 18:03:43.147233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 388/789] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:43.280594 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:43.280594 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:43.287182 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.288858 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.290900 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.292102 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.489539 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:43.490467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:43.492963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:43.498907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.499659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.500434 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.501042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.501734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=10 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:43.521836 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:43.540608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-80653ca9-540a-4429-a507-9091d6087292 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1725 microversion: 2.1 time: 0.277202 Jun 14 18:03:43.543105 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 402/790] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:43 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:43.676358 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:43.685078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5ae79327-23f4-4948-9ad9-bd241e45d151 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1565 microversion: 2.1 time: 0.200500 Jun 14 18:03:43.685668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 389/791] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:43 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1565 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:43.703521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:43.703521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:43.713218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.713218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.713798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.714264 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.721324 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:43.722000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:43.728841 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.729299 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.730222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.730668 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.883391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:43.897317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a68265f2-4d9a-4c45-9b9c-adcd69db9900 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.179891 Jun 14 18:03:43.897927 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 390/792] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:43 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:43.903549 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:43.904507 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:43.911973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.912418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.913266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:43.913714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:43.948437 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bb131d57-1cd7-4209-b2a5-d94a0fc18123 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049368 Jun 14 18:03:43.955429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 391/793] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:03:43 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:03:44.028874 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5423b278-cdf3-4333-bc47-4cc4103dd3ca tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "POST /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9/action" status: 202 len: 0 microversion: 2.1 time: 0.330170 Jun 14 18:03:44.030433 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 403/794] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:03:43 2022] POST /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:03:44.038875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:44.039647 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:44.039907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:44.040266 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:44.048759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.049284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.050283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.050718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.051002 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.051720 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.052687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.053292 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.090008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:03:44.277403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:44.289000 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-010fe7c7-d6f7-45a2-ba38-0199bee35326 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1573 microversion: 2.1 time: 0.253345 Jun 14 18:03:44.290864 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 404/795] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:44 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1573 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:44.298909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-0acf7f5a-7775-47dd-970f-74d413aa1ede req-57e1e74b-aa91-4bee-99f0-5c2e93035ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "name": "network-vif-unplugged", "status": "completed", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:44.348468 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0acf7f5a-7775-47dd-970f-74d413aa1ede req-57e1e74b-aa91-4bee-99f0-5c2e93035ebd service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.349986 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0acf7f5a-7775-47dd-970f-74d413aa1ede req-57e1e74b-aa91-4bee-99f0-5c2e93035ebd service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.365134 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-0acf7f5a-7775-47dd-970f-74d413aa1ede req-57e1e74b-aa91-4bee-99f0-5c2e93035ebd service nova] Creating event network-vif-unplugged:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:03:44.382464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-0acf7f5a-7775-47dd-970f-74d413aa1ede req-57e1e74b-aa91-4bee-99f0-5c2e93035ebd service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089482 Jun 14 18:03:44.384392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 405/796] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:44.507943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-33792f28-4b15-41e9-bbe8-af71af419e55 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 204 len: 0 microversion: 2.1 time: 0.476216 Jun 14 18:03:44.508717 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 392/797] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:03:44 2022] DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:03:44.521955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:44.522672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:44.531948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.532402 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.533481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.533996 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.561678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:44.562368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:44.570245 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.571013 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.571838 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.572273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.732203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:44.742599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5006d444-2fe0-4264-9242-3f0655e7dc88 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1680 microversion: 2.1 time: 0.228159 Jun 14 18:03:44.749446 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 406/798] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:44 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:44.884048 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:44.893013 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4eb30bf5-1a2e-4a41-bc5f-25244338394c tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1731 microversion: 2.1 time: 0.335297 Jun 14 18:03:44.893597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 393/799] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:44 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1731 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:44.909945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:44.910561 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:44.912718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:44.917845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.918209 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:44.918320 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.919008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:44.919149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.919529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.926035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.926487 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:44.930069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:44.930069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:45.006740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fe23bca0-9cd0-45e4-828c-47fd9e420ea4 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100965 Jun 14 18:03:45.007481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 407/800] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 18:03:44 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:45.306281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:45.307054 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:45.314067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:45.314529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:45.315322 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:45.315785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:45.422599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:45.437178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-752f7a24-37a1-4544-889e-3a8bc8c853bc tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.523011 Jun 14 18:03:45.438094 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 394/801] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:44 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:45.506375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:45.514982 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c69ae3bb-6a84-4883-9c88-16f1da0a77f5 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1513 microversion: 2.1 time: 0.212293 Jun 14 18:03:45.515716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 408/802] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:45 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:45.762019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:45.762818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:45.770846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:45.771427 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:45.772305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:45.772815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:45.794010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:46.086017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:46.093722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a4666ae7-a0d4-4126-a38a-1cb64e090c6a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1680 microversion: 2.1 time: 0.336216 Jun 14 18:03:46.094288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 395/803] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:45 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1680 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:46.458344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:46.459087 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:46.468910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:46.469744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:46.472552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:46.473362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:46.536917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:46.537972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:46.546913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:46.554867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:46.554867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:46.554867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:46.677135 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:46.686962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7b865924-baaf-47ae-b58c-78fbe8a6e226 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.234922 Jun 14 18:03:46.687748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 409/804] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:46 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:46.932494 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:46.943119 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7dda8486-a7da-4893-9390-80f95e317684 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1515 microversion: 2.1 time: 0.412958 Jun 14 18:03:46.944157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 396/805] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:46 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1515 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:47.027168 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-0c000cfb-75f1-4de7-9650-e745b91ce737 req-8f7b2712-9dcf-49f8-bac3-413a5990daa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4183d50a-65d3-47a0-90bd-ec11efad799a", "tag": "1fcab755-2ded-49b3-bc1b-1d3480979cd3"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:47.052798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0c000cfb-75f1-4de7-9650-e745b91ce737 req-8f7b2712-9dcf-49f8-bac3-413a5990daa5 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.054081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0c000cfb-75f1-4de7-9650-e745b91ce737 req-8f7b2712-9dcf-49f8-bac3-413a5990daa5 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:47.090653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-0c000cfb-75f1-4de7-9650-e745b91ce737 req-8f7b2712-9dcf-49f8-bac3-413a5990daa5 service nova] Creating event network-changed:1fcab755-2ded-49b3-bc1b-1d3480979cd3 for instance 4183d50a-65d3-47a0-90bd-ec11efad799a on hv-cinder-82635 Jun 14 18:03:47.101960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-0c000cfb-75f1-4de7-9650-e745b91ce737 req-8f7b2712-9dcf-49f8-bac3-413a5990daa5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077454 Jun 14 18:03:47.103389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 410/806] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:47.114753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:47.114753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:47.130391 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.131475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:47.132851 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.133515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:47.311898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:47.320833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-61349e05-298f-46a9-bd39-810626f38868 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1680 microversion: 2.1 time: 0.212503 Jun 14 18:03:47.321415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 397/807] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:47 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:47.705036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:47.706412 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:47.739406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.741392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:47.742227 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.746813 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:47.963706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:47.964586 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:47.982269 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.982742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:47.983601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:47.984169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:48.029992 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:48.039350 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a80ada87-9a1d-474f-bf32-2118ca7a5ea0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.339023 Jun 14 18:03:48.040727 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 411/808] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:47 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:48.211056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:48.235240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-69b61733-37c3-4572-9167-53390c6024c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1515 microversion: 2.1 time: 0.277935 Jun 14 18:03:48.254149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 398/809] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:47 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:48.340547 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:48.341318 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:48.350754 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:48.351556 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:48.352812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:48.353508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:48.416006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:48.418752 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:48.420443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:03:48.433391 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:03:48.578549 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:48.589927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-da38cdb3-6093-4057-a0c6-92d4d1443b9f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 200 len: 1331 microversion: 2.1 time: 0.253453 Jun 14 18:03:48.590926 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 412/810] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:48 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 1331 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:49.061363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:49.064868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:49.074925 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.094175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.097898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.100077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.350851 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-38e0d35a-dcf9-410f-b572-17966bf53a2b req-c0628377-4583-49a6-a699-2a6a2042a76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4183d50a-65d3-47a0-90bd-ec11efad799a", "tag": "1fcab755-2ded-49b3-bc1b-1d3480979cd3"}, {"server_uuid": "4b39a9a6-8711-4f93-9a26-7d1f05e71af8", "name": "network-vif-deleted", "tag": "df0f3835-b823-46a5-a3ab-0779d0a8a08b"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:49.363704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-38e0d35a-dcf9-410f-b572-17966bf53a2b req-c0628377-4583-49a6-a699-2a6a2042a76f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.364126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-38e0d35a-dcf9-410f-b572-17966bf53a2b req-c0628377-4583-49a6-a699-2a6a2042a76f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.383125 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-38e0d35a-dcf9-410f-b572-17966bf53a2b req-c0628377-4583-49a6-a699-2a6a2042a76f service nova] Creating event network-changed:1fcab755-2ded-49b3-bc1b-1d3480979cd3 for instance 4183d50a-65d3-47a0-90bd-ec11efad799a on hv-cinder-82635 Jun 14 18:03:49.383667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-38e0d35a-dcf9-410f-b572-17966bf53a2b req-c0628377-4583-49a6-a699-2a6a2042a76f service nova] Creating event network-vif-deleted:df0f3835-b823-46a5-a3ab-0779d0a8a08b for instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 on hv-cinder-82635 Jun 14 18:03:49.390797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-38e0d35a-dcf9-410f-b572-17966bf53a2b req-c0628377-4583-49a6-a699-2a6a2042a76f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.254264 Jun 14 18:03:49.391828 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 413/811] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:49.398609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:49.400009 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:49.407196 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.408541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.409823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.410614 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.664436 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:49.674668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-24588e4a-2ef2-4d84-b0b3-731e4c6767f0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.280459 Jun 14 18:03:49.675726 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 414/812] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:49 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:49.681238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:49.681856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:49.688568 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.689880 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.690987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:49.691631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:49.719246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 HTTP/1.1 Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:03:49.722388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:03:49.724119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '4b39a9a6-8711-4f93-9a26-7d1f05e71af8'} Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:03:49.724954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:03:49.726307 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:03:49.728242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:03:49.729834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-61fd1cf0-6831-47f8-9355-c4fe8c1a6de3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 404 len: 111 microversion: 2.1 time: 0.052879 Jun 14 18:03:49.730704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 415/813] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:49 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:03:49.739083 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ed3ed1b5-4025-4df1-a908-3dd4d95bf153 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '.version_select at 0x7fbafc7c70d0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:49.819165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ed3ed1b5-4025-4df1-a908-3dd4d95bf153 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-447013395" status: 202 len: 0 microversion: 2.1 time: 0.084233 Jun 14 18:03:49.819855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 416/814] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 14 18:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-447013395 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:03:49.907959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:49.916586 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-63db284d-b0da-4e74-9b5b-1c2c9c49ff5d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.862279 Jun 14 18:03:49.917476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 399/815] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:49 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:50.491729 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-a5a4c8f9-b1e4-4a20-a9a0-b18e49dfe03f req-2502ac4b-bb9e-46c4-babd-d4d8cf433453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7de29b-12b3-439a-a994-5eada188817d", "name": "network-vif-plugged", "status": "completed", "tag": "2d358ed7-706f-4cd0-a87a-d21304bfb6b6"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:50.501145 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-a5a4c8f9-b1e4-4a20-a9a0-b18e49dfe03f req-2502ac4b-bb9e-46c4-babd-d4d8cf433453 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:50.502779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-a5a4c8f9-b1e4-4a20-a9a0-b18e49dfe03f req-2502ac4b-bb9e-46c4-babd-d4d8cf433453 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:50.515539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-a5a4c8f9-b1e4-4a20-a9a0-b18e49dfe03f req-2502ac4b-bb9e-46c4-babd-d4d8cf433453 service nova] Creating event network-vif-plugged:2d358ed7-706f-4cd0-a87a-d21304bfb6b6 for instance 1c7de29b-12b3-439a-a994-5eada188817d on hv-cinder-82635 Jun 14 18:03:50.521957 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-a5a4c8f9-b1e4-4a20-a9a0-b18e49dfe03f req-2502ac4b-bb9e-46c4-babd-d4d8cf433453 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106267 Jun 14 18:03:50.522871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 417/816] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:50.701385 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:50.702823 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:50.710119 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:50.710649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:50.713471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:50.713923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:50.923056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:50.935655 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:50.936675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:50.938260 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a5f9d461-67d6-4a06-9554-688bd9a64f94 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.241203 Jun 14 18:03:50.939986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 400/817] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:50 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:50.949144 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:50.956121 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:50.957104 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:50.957565 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:50.977310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7b53eeb2-86eb-4ee6-a743-1e11cb468140 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: .version_select at 0x7fbafc0db3a0>, body: {"keypair": {"name": "tempest-keypair-144962738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxGC111c7Uw2qJzDnMqabnM3hOhP67adp5Rbo/dw9cayYpFz0ntBoxY4O40BX5IRFlOM9j/vNHfaIyBig4kdpLnweUVey5Vt4yvgXasJxBAC5U7TlgrRtPgnklsygP6jQ=="}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:50.994146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-7b53eeb2-86eb-4ee6-a743-1e11cb468140 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:03:51.001130 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-7b53eeb2-86eb-4ee6-a743-1e11cb468140 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'key_pairs'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:03:51.102824 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7b53eeb2-86eb-4ee6-a743-1e11cb468140 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127327 Jun 14 18:03:51.110013 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 401/818] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:03:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:51.179625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:51.187606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-45cd79db-899f-4e33-a8b9-44715bb86827 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.257236 Jun 14 18:03:51.188197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 418/819] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:50 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:51.964923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:51.967673 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:51.974948 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:51.975487 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:51.976287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:51.976735 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:52.184553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:52.195276 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c4582cde-c23e-424e-a1b0-33b0335c0c61 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.236932 Jun 14 18:03:52.196105 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 402/820] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:51 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:52.213379 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:52.214020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:52.225682 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:52.226216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:52.227182 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:52.227681 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:52.425271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:52.434007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a7e8973e-b927-45de-8445-ffe3fec27c03 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1364 microversion: 2.1 time: 0.227154 Jun 14 18:03:52.445160 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 419/821] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:52 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:53.219028 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:53.219740 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:53.230767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:53.231557 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:53.232776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:53.233394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:53.453119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:53.455347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:53.464368 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:53.471969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:53.471969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:53.471969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:53.512865 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:53.525441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ba124401-48ff-4172-8fec-52c5249bece1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.312139 Jun 14 18:03:53.531937 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 403/822] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:53 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:53.771885 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:53.786654 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4fc78451-c97c-403d-bdcb-17ffbf577093 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1550 microversion: 2.1 time: 0.337987 Jun 14 18:03:53.788035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 420/823] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:53 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1550 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:53.821527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:53.824443 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:53.833805 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:53.834951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:53.836525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:53.837244 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:54.125037 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-73241488-0225-4a5d-9e10-33cea1640789 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.311536 Jun 14 18:03:54.125943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 404/824] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 18:03:53 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-interface => generated 284 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:03:54.543747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:54.544420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:54.551577 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:54.552029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:54.552902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:54.553341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:54.691902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1190595876", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0964eb9b-e0dc-493c-8b01-2ac272fdf32e"}], "security_groups": [{"name": "tempest-securitygroup--1161411945"}], "key_name": "tempest-keypair-144962738", "user_data": "}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:54.736162 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:54.755353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-28ad50e1-5b4a-4c33-986f-93ae25c01c4e tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.215325 Jun 14 18:03:54.765551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 421/825] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:54 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:55.003627 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] validate_networks() for [('0964eb9b-e0dc-493c-8b01-2ac272fdf32e', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:03:55.773370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:55.775105 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:55.784091 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:55.785814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:55.787881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:55.788401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:55.956709 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:55.965838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7bfa324c-8c54-486b-bbf8-a19c2d62fc0a tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.196737 Jun 14 18:03:55.967201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 422/826] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:55 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:03:56.336754 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:03:56.337242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:03:56.337596 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:03:56.338017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:03:56.338598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:03:56.349684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:56.350139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:56.351095 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:56.351585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:56.378736 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:03:56.384591 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Getting quotas for user 9c7ab182f1fd41718376a8e2f03ec87c and project 865c9f495fc24f8fb216d11917309a95. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:03:56.406940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:03:56.410125 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:03:56.463724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-8689ff53-5de8-421c-983e-35e87b9327b4 req-73683d29-3c6a-4795-bfbc-885c25196515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7de29b-12b3-439a-a994-5eada188817d", "tag": "2d358ed7-706f-4cd0-a87a-d21304bfb6b6"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:03:56.479114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-8689ff53-5de8-421c-983e-35e87b9327b4 req-73683d29-3c6a-4795-bfbc-885c25196515 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:56.479838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-8689ff53-5de8-421c-983e-35e87b9327b4 req-73683d29-3c6a-4795-bfbc-885c25196515 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:56.499419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-8689ff53-5de8-421c-983e-35e87b9327b4 req-73683d29-3c6a-4795-bfbc-885c25196515 service nova] Creating event network-changed:2d358ed7-706f-4cd0-a87a-d21304bfb6b6 for instance 1c7de29b-12b3-439a-a994-5eada188817d on hv-cinder-82635 Jun 14 18:03:56.505165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-8689ff53-5de8-421c-983e-35e87b9327b4 req-73683d29-3c6a-4795-bfbc-885c25196515 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048938 Jun 14 18:03:56.505781 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 423/827] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:03:56.601817 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-73b04760-1199-4169-b8f4-9271a3bac5fa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.915308 Jun 14 18:03:56.606642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 405/828] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:03:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:03:56.621797 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c66fd5fd-a536-44de-b852-2ced3060746c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:56.622507 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c66fd5fd-a536-44de-b852-2ced3060746c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:56.762343 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c66fd5fd-a536-44de-b852-2ced3060746c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:56.778845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c66fd5fd-a536-44de-b852-2ced3060746c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1241 microversion: 2.1 time: 0.161490 Jun 14 18:03:56.792158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 424/829] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:56 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1241 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:56.984256 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:56.985230 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:56.994848 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:56.995947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:56.997294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:56.997920 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:57.413822 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:57.449738 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-aa17057c-8419-48f4-936e-a00a92c9d143 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.468188 Jun 14 18:03:57.452340 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 406/830] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:56 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:57.802583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:57.804319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:57.811931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:57.812382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:57.813151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:57.814390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:57.901296 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:57.927650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e847ff27-824e-4ef3-9d13-166ad6fb2f90 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1245 microversion: 2.1 time: 0.129156 Jun 14 18:03:57.928710 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 425/831] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:57 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:58.468725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:58.470252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:58.481258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:58.481258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:58.481258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:58.481258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:58.664825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:58.676776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-72eeab63-edca-4636-b74b-7bf5a48060c1 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.212962 Jun 14 18:03:58.677368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 407/832] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:58 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:58.960158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:58.962115 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:58.976903 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:58.977928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:58.979100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:58.979766 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:59.199323 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:03:59.208795 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0f0db33e-756e-4f4d-9181-192312d46c2d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1293 microversion: 2.1 time: 0.256594 Jun 14 18:03:59.209698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 426/833] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:58 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:03:59.697714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:03:59.698613 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:03:59.719137 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:59.719608 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:03:59.720654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:03:59.721178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:00.006536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:00.019515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b2a2c2b4-2fec-4b55-96d1-386e0177ca73 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.329392 Jun 14 18:04:00.020933 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 408/834] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:03:59 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:00.228562 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:00.229184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:00.242965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:00.243721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:00.244752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:00.245418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:00.425042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:00.441980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-884c7426-c8e6-4189-a15b-8920f1dc0998 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1299 microversion: 2.1 time: 0.217309 Jun 14 18:04:00.456929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 409/835] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:00 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1299 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:00.552782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:00.553696 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:00.568717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:00.568717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:00.568717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:00.568717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:00.601287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-d5ee0f10-2412-402a-af47-899c6efdbf9f req-9b4b40e1-7f7b-46c1-a941-0a74c4b43dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "name": "network-vif-plugged", "status": "completed", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:00.620912 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-d5ee0f10-2412-402a-af47-899c6efdbf9f req-9b4b40e1-7f7b-46c1-a941-0a74c4b43dfe service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:00.622122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-d5ee0f10-2412-402a-af47-899c6efdbf9f req-9b4b40e1-7f7b-46c1-a941-0a74c4b43dfe service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:00.651043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-d5ee0f10-2412-402a-af47-899c6efdbf9f req-9b4b40e1-7f7b-46c1-a941-0a74c4b43dfe service nova] Creating event network-vif-plugged:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:04:00.662761 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-d5ee0f10-2412-402a-af47-899c6efdbf9f req-9b4b40e1-7f7b-46c1-a941-0a74c4b43dfe service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064687 Jun 14 18:04:00.664284 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 410/836] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:04:00.809960 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-910bd332-4817-4992-ad84-c487569d7ac7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/ips" status: 200 len: 153 microversion: 2.20 time: 1.010573 Jun 14 18:04:00.829520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 427/837] 10.222.0.36 () {60 vars in 1288 bytes} [Tue Jun 14 18:03:59 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/ips => generated 153 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:04:01.076203 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:01.078445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:01.099993 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:01.100564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:01.101564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:01.102082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:01.534005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:01.534005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:01.534005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:01.534005 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:01.534645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:01.534645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:01.573583 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:01.588106 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-883f0cfe-3eae-4d23-8f81-bb5fd04de9d0 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.530476 Jun 14 18:04:01.592243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 411/838] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:01 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:01.835809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:01.853011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-76ad8776-67f7-498d-957d-8eefc5414b80 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.376321 Jun 14 18:04:01.854279 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 428/839] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:01 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:02.622345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:02.636873 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:02.660368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:02.660368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:02.660368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:02.660368 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:02.878716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:02.882128 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:02.923989 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:02.926199 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:02.929983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:02.930883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:03.108195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:03.127971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ae4a6aa0-7e84-46ce-928b-77f8714a3d70 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1571 microversion: 2.1 time: 0.518564 Jun 14 18:04:03.130866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 412/840] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:02 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1571 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:03.271490 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-cd4c6e64-b957-4c3e-97f2-7fbd3d3bc1af req-83fc5f0d-0c84-4692-97f1-566adafd3094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1f5950-ab86-4273-97f5-344d55db99d7", "tag": "7385caf6-a8e2-4117-95cb-dfcb0100cd45"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:03.295825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-cd4c6e64-b957-4c3e-97f2-7fbd3d3bc1af req-83fc5f0d-0c84-4692-97f1-566adafd3094 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:03.296282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-cd4c6e64-b957-4c3e-97f2-7fbd3d3bc1af req-83fc5f0d-0c84-4692-97f1-566adafd3094 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:03.313142 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:03.315361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-cd4c6e64-b957-4c3e-97f2-7fbd3d3bc1af req-83fc5f0d-0c84-4692-97f1-566adafd3094 service nova] Creating event network-changed:7385caf6-a8e2-4117-95cb-dfcb0100cd45 for instance 4b1f5950-ab86-4273-97f5-344d55db99d7 on hv-cinder-82635 Jun 14 18:04:03.321488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-cd4c6e64-b957-4c3e-97f2-7fbd3d3bc1af req-83fc5f0d-0c84-4692-97f1-566adafd3094 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056523 Jun 14 18:04:03.327469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f3cefb3b-adb6-4a71-8673-72968be24cf5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.455496 Jun 14 18:04:03.327747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 413/841] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:03.327995 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 429/842] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:02 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:03.620024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:03.621100 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:03.625273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:03.635384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:03.639522 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:03.639522 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:03.639522 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:03.687421 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lazy-loading 'flavor' on Instance uuid 9f04acf5-db93-42a3-8950-c3ccccca5db2 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:03.725234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:04.152554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:04.153269 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:04.165375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:04.165827 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:04.166605 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:04.167035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:04.419645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:04.432457 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e774c6e5-5b09-4664-b860-b95683bf9f9b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1558 microversion: 2.1 time: 0.283533 Jun 14 18:04:04.441030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 430/843] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:04 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1558 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:04.448522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:04.451399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:04.453227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-262a6e06-b5eb-4edf-a609-462d047b862b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/action" status: 202 len: 0 microversion: 2.20 time: 0.837552 Jun 14 18:04:04.457722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 414/844] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 14 18:04:03 2022] POST /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/action => generated 0 bytes in 843 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:04:04.464553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:04.465423 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:04.471539 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:04.473990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:04.478165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:04.478165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:04.480742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:04.483410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:04.484950 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:04.484950 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:04.707032 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:04.715357 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e228ff37-38e6-459c-b7f4-11944c746a19 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.272151 Jun 14 18:04:04.715950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 431/845] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:04 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:04.745508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:04.754169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:04.755737 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:04.756962 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6c2898e8-7562-4e3d-88cc-750394257fd7 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.296883 Jun 14 18:04:04.757519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 415/846] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:04 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:05.734011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:05.734643 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:05.746323 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:05.748359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:05.748708 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:05.749177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:05.776189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:05.776823 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:05.789204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:05.791326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:05.793734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:05.795483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:05.933961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:05.946520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5ad6256b-347f-4dd6-a11c-2ff5ca01f872 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.216669 Jun 14 18:04:05.947228 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 432/847] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:05 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:06.046482 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:06.059875 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:06.064243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:06.065641 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9e4e7e50-2edb-447f-a8f4-c3bef6e0f7fc tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.293711 Jun 14 18:04:06.078038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 416/848] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:05 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:06.966066 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:06.966742 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:06.969623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:06.970324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:06.981597 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:06.982064 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:06.982927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:06.983314 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:07.120514 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:07.122733 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:07.128822 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:07.130069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=10 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:07.138921 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:07.140149 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:07.143389 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:07.144673 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:07.244941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:07.258143 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-54112009-6719-4987-8a40-d19dcc0ecea8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.296079 Jun 14 18:04:07.258737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 433/849] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:06 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:07.470273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:07.479177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:07.480955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:07.482191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5664343c-bbee-4a7a-9dba-98be939ede7e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.398746 Jun 14 18:04:07.482763 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 417/850] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:07 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:07.957358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e936b472-4b0f-4aaf-bf03-d8aa4760de2a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Action: 'create', calling method: .version_select at 0x7fbafc863670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1930342607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUoXm2p4LzGbyZkdwLkuAKEIR3s6AxSSpCnQZh5lJH0p5vlm4A1h4K9eBj9PhtKEDPKQ5LTXWKXMoH1cEgvFQklCsPtRV0zThn2TPPacznd1y7UmSv5WUL0GIcmQ8NlSA=="}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:07.973521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-e936b472-4b0f-4aaf-bf03-d8aa4760de2a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for project f61370c4497b496487383283e474bc3a. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:04:07.977928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-e936b472-4b0f-4aaf-bf03-d8aa4760de2a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for user da59091825d44440887d6ef9c542b1ce and project f61370c4497b496487383283e474bc3a. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:04:08.150017 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e936b472-4b0f-4aaf-bf03-d8aa4760de2a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.317067 Jun 14 18:04:08.151236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 434/851] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:04:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:08.275968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:08.276601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:08.284433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:08.285252 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:08.286048 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:08.286486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:08.412779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-ec36e50e-a6e2-46dc-a91b-295adb5133ea req-aa53cb15-36d7-4de9-985a-485202afea91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1f5950-ab86-4273-97f5-344d55db99d7", "name": "network-vif-plugged", "status": "completed", "tag": "7385caf6-a8e2-4117-95cb-dfcb0100cd45"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:08.427785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-ec36e50e-a6e2-46dc-a91b-295adb5133ea req-aa53cb15-36d7-4de9-985a-485202afea91 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:08.428319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-ec36e50e-a6e2-46dc-a91b-295adb5133ea req-aa53cb15-36d7-4de9-985a-485202afea91 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:08.432740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:08.439809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-ec36e50e-a6e2-46dc-a91b-295adb5133ea req-aa53cb15-36d7-4de9-985a-485202afea91 service nova] Creating event network-vif-plugged:7385caf6-a8e2-4117-95cb-dfcb0100cd45 for instance 4b1f5950-ab86-4273-97f5-344d55db99d7 on hv-cinder-82635 Jun 14 18:04:08.444879 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-ec36e50e-a6e2-46dc-a91b-295adb5133ea req-aa53cb15-36d7-4de9-985a-485202afea91 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037292 Jun 14 18:04:08.445677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 435/852] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:04:08.455093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:08.464408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-73466817-655d-43c1-bec0-bed5e7d58f60 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.192941 Jun 14 18:04:08.467074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 418/853] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:08 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:08.508748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:08.509456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:08.518537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:08.524229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:08.524229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:08.524229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:08.679128 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:08.697374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:08.701006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:08.703358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a53faf47-d79b-45d5-909a-79210a140ace tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.200450 Jun 14 18:04:08.717611 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 436/854] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:08 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:09.482028 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:09.482757 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:09.490679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:09.491182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:09.492064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:09.492511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:09.645758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:09.654727 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c3873f3d-ea61-45ae-8475-672bee793c1f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.176562 Jun 14 18:04:09.655343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 419/855] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:09 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:09.725246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:09.725875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:09.738759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:09.739889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:09.741477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:09.742100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:09.909023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:09.917673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:09.920712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:09.920712 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5cca393e-b17f-4168-831e-7190736c61af tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.199669 Jun 14 18:04:09.931056 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 437/856] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:09 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:10.674089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:10.676834 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:10.684266 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:10.684726 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:10.686129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:10.686129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:10.885286 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:10.908145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e109bc41-dfba-45d4-bcf9-7d4f97951ca8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1367 microversion: 2.1 time: 0.238690 Jun 14 18:04:10.917646 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 420/857] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:10 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:10.949012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:10.953924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:10.969755 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:10.971941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:10.973947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:10.976107 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:11.265237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:11.273947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:11.275944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:11.277253 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e6c19f6a-3029-4238-b2b0-0d1b58b7f067 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.339201 Jun 14 18:04:11.277830 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 438/858] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:10 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:11.944228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:11.944963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:11.952593 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:11.953020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:11.953845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:11.954354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:12.100291 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:12.108669 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fc9b733d-4c1d-43f7-ae60-8b9833d70b3f tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1557 microversion: 2.1 time: 0.168315 Jun 14 18:04:12.109130 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 421/859] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:11 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:12.126660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:12.127464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:12.134370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:12.134828 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:12.135834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:12.137049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:12.241197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4d866a51-11c8-4244-a624-21a183e5bc89 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118420 Jun 14 18:04:12.242014 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 439/860] 10.222.0.36 () {58 vars in 1274 bytes} [Tue Jun 14 18:04:12 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:12.297795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:12.299792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:12.317676 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:12.318664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:12.320471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:12.321287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:12.593867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:12.602670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:12.604285 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:12.605486 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6a31bc6e-55c3-450d-b430-4c1c7590fce5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.312099 Jun 14 18:04:12.615812 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 422/861] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:12 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:13.625351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:13.625858 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:13.633602 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:13.634131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:13.634984 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:13.635522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:13.682523 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-89c64025-4eb6-4c7b-bb59-45a73189c7be req-5ce7d950-6912-4fc2-a648-65651b7e8944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b1f5950-ab86-4273-97f5-344d55db99d7", "tag": "7385caf6-a8e2-4117-95cb-dfcb0100cd45"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:13.692327 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-89c64025-4eb6-4c7b-bb59-45a73189c7be req-5ce7d950-6912-4fc2-a648-65651b7e8944 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:13.693118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-89c64025-4eb6-4c7b-bb59-45a73189c7be req-5ce7d950-6912-4fc2-a648-65651b7e8944 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:13.707158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-89c64025-4eb6-4c7b-bb59-45a73189c7be req-5ce7d950-6912-4fc2-a648-65651b7e8944 service nova] Creating event network-changed:7385caf6-a8e2-4117-95cb-dfcb0100cd45 for instance 4b1f5950-ab86-4273-97f5-344d55db99d7 on hv-cinder-82635 Jun 14 18:04:13.712792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-89c64025-4eb6-4c7b-bb59-45a73189c7be req-5ce7d950-6912-4fc2-a648-65651b7e8944 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034108 Jun 14 18:04:13.713627 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 423/862] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:13.801862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:13.810378 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:13.811947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:13.813177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5f40d45f-c95c-4f58-a7cc-9acf130a78b2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.192431 Jun 14 18:04:13.813986 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 440/863] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:13 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:14.834458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:14.835408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:14.842684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:14.843220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:14.844054 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:14.844491 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:14.988950 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:14.997533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:14.999757 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:15.001894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-092a7d35-99f3-4638-ad1b-f7fdc2c8169e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.172120 Jun 14 18:04:15.002973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 424/864] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:14 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:16.021305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:16.021883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:16.029104 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:16.029557 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:16.030336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:16.030772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:16.167495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:16.176722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:16.178218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:16.179394 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-36db4cf7-7b3f-4a3b-875a-bd18d674cfe4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1745 microversion: 2.20 time: 0.162708 Jun 14 18:04:16.179946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 441/865] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:16 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:17.199422 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:17.200122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:17.207858 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:17.208445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:17.209253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:17.209696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:17.356177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:17.366082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:17.367619 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:17.368839 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a46036e9-236a-40c4-91d9-9b3bf4e4905b tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1745 microversion: 2.20 time: 0.173317 Jun 14 18:04:17.369412 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 425/866] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:17 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:18.368346 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-5be1c47f-efbb-4f53-9d20-36f71dfb73c0 req-3adbf9c7-583f-43b5-803b-b4ba200c6536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "name": "network-vif-plugged", "status": "completed", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:18.372621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:18.380707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-5be1c47f-efbb-4f53-9d20-36f71dfb73c0 req-3adbf9c7-583f-43b5-803b-b4ba200c6536 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:18.381372 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-5be1c47f-efbb-4f53-9d20-36f71dfb73c0 req-3adbf9c7-583f-43b5-803b-b4ba200c6536 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:18.388576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:18.390715 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:18.399700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:18.400580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:18.401456 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:18.401966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:18.404608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-5be1c47f-efbb-4f53-9d20-36f71dfb73c0 req-3adbf9c7-583f-43b5-803b-b4ba200c6536 service nova] Creating event network-vif-plugged:dfae5e13-77b4-4719-a356-b4aed071f325 for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 on hv-cinder-82635 Jun 14 18:04:18.414064 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-5be1c47f-efbb-4f53-9d20-36f71dfb73c0 req-3adbf9c7-583f-43b5-803b-b4ba200c6536 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049048 Jun 14 18:04:18.415158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 442/867] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:18.590699 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:18.600300 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:18.601896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:18.603066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-21596a51-e4ce-4a61-9c83-c523a0ee6ced tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1745 microversion: 2.20 time: 0.218809 Jun 14 18:04:18.603666 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 426/868] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:18 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:19.623776 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:19.624496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:19.632508 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:19.632964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:19.633730 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:19.634159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:19.841659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:19.852388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:19.854645 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:19.856657 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9d6da92a-f99a-4c67-922f-b0914e3b8c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.237265 Jun 14 18:04:19.858390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 443/869] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:19 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:20.882737 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:20.882737 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:20.895485 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:20.896356 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:20.897390 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:20.898346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:21.152140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:21.160016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:21.161624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:21.162836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-99226884-226b-4872-9072-2f37da462c42 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.286252 Jun 14 18:04:21.163911 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 427/870] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:20 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:22.182706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:22.184700 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:22.192229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:22.193090 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:22.194319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:22.194935 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:22.373687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:22.386535 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:22.388157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:22.389827 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b5279a6a-c875-48cc-8595-92027f9f08a3 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.210829 Jun 14 18:04:22.390706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 444/871] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:22 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:23.408832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:23.410011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:23.423062 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:23.423563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:23.424384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:23.425036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:23.599015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:23.616811 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:23.618433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:23.619912 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7b9750dd-abd0-4fe1-96eb-fe9e14e2c51c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.215817 Jun 14 18:04:23.620616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 428/872] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:23 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:24.638124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:24.639455 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:24.647961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:24.648422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:24.649222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:24.649804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:24.810161 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:24.823016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:24.824629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:24.826055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ad3b0e73-c8d8-47c9-84f9-6ad9b7ef8e16 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.191941 Jun 14 18:04:24.841543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 445/873] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:24 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:24.998786 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:24.999496 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:25.006696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:25.007146 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:25.007949 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:25.008557 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:25.104670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'services' on Instance uuid 4183d50a-65d3-47a0-90bd-ec11efad799a {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:25.253233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:25.343155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8c6fc452-b480-4299-bb9b-2ac01b4ee66b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments/9e6e990c-ab41-403b-88f9-95479a73c3fa" status: 202 len: 0 microversion: 2.1 time: 0.348213 Jun 14 18:04:25.344014 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 429/874] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:04:24 2022] DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments/9e6e990c-ab41-403b-88f9-95479a73c3fa => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:04:25.353541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:25.359068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:25.363589 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:25.364291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:25.365163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:25.365675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:25.411108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-fbab5010-b764-454b-ace7-5773acf2cd99 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062706 Jun 14 18:04:25.412805 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 446/875] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:04:25 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:04:25.847272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:25.847974 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:25.855943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:25.856404 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:25.857209 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:25.857656 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:26.011846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:26.020441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:26.022030 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:26.023215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4c4f8a1d-c75a-4ade-bd0b-7a4e595f1c7d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.180972 Jun 14 18:04:26.023850 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 430/876] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:25 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:26.424170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:26.425359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:26.433220 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:26.433667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:26.434486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:26.434915 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:26.469022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-70c98a13-8817-4172-bbed-bb5bbd63ff46 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Jun 14 18:04:26.469628 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 447/877] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:04:26 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:27.042983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:27.043905 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:27.052424 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.052825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.054036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.054638 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.196417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:27.206483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:27.208341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:27.209511 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7dca1458-5132-4250-ad56-5fe3a7d1b2ad tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.170615 Jun 14 18:04:27.210381 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 431/878] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:27 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:27.483486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:27.484636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:27.491331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.491801 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.492575 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.493020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.532152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0b1a0ae3-821b-45aa-80df-52eb74f58cd9 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052662 Jun 14 18:04:27.532806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 448/879] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:04:27 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:04:27.611859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:27.612366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:27.618871 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.619342 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.620125 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.620566 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.646515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:04:27.972527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5b9f2e9e-322c-41cb-9c88-c64d02092604 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 204 len: 0 microversion: 2.1 time: 0.364164 Jun 14 18:04:27.973152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 432/880] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:04:27 2022] DELETE /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:04:27.981244 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:27.981925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:27.988747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.989200 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:27.989958 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:27.990399 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:28.137675 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:28.145560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a154123a-56f9-4177-8e7a-e0d8f0f8e47d tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1691 microversion: 2.1 time: 0.168214 Jun 14 18:04:28.146351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 449/881] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:27 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:28.229657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:28.230355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:28.237782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:28.238249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:28.239026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:28.240107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:28.373538 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:28.382423 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:28.384029 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:28.385267 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-71cec1b4-d15e-4908-aa67-2faa84766c20 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.159870 Jun 14 18:04:28.386078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 433/882] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:28 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:29.164457 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:29.165161 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:29.172251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:29.172718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:29.174181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:29.174623 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:29.325776 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:29.334325 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4bcc22ff-ece8-4616-8c5c-2fbf188b0f76 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1691 microversion: 2.1 time: 0.173584 Jun 14 18:04:29.334896 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 450/883] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:29 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:29.404987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:29.406011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:29.413808 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:29.418701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:29.418701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:29.418701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:29.574576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:29.584631 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:29.586472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:29.587716 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6ec6f0f9-942a-4c1e-94d9-a97327487829 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.186677 Jun 14 18:04:29.600595 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 434/884] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:29 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:30.302395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-812389204", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930342607", "security_groups": [{"name": "tempest-secgroup-smoke-163578328"}], "block_device_mapping_v2": [{"uuid": "4fa9f864-4836-4bb5-b472-f4f7ec6d8408", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77be5dba-7c4d-415d-be45-9164b79f49bd"}]}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:30.354197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:30.354197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:30.359653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:30.360144 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:30.360970 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:30.361405 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:30.427692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] validate_networks() for [('77be5dba-7c4d-415d-be45-9164b79f49bd', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:04:30.510567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:30.520020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5295ae41-367f-44ce-ae08-1ca15f13fcfa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1691 microversion: 2.1 time: 0.171578 Jun 14 18:04:30.527444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 435/885] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:30 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:30.606351 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:30.606976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:30.613700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:30.614273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:30.615039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:30.615514 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:30.769168 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:30.781748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:30.783903 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:30.785674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fc4d92a8-563a-45d5-8122-514f824f3076 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.183381 Jun 14 18:04:30.786782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 436/886] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:30 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:31.004913 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:04:31.005629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:04:31.006333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:04:31.007229 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:04:31.008159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:04:31.020672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:31.021332 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:31.022143 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:31.023333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:31.046268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for project f61370c4497b496487383283e474bc3a. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:04:31.053342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for user da59091825d44440887d6ef9c542b1ce and project f61370c4497b496487383283e474bc3a. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:04:31.119983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:04:31.125294 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fa9f864-4836-4bb5-b472-f4f7ec6d8408',volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:04:31.543765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:31.544384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:31.551091 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:31.551576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:31.552429 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:31.552937 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:31.690997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:31.698670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7e1d393f-dd03-41ab-ac00-8d98caea689b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1691 microversion: 2.1 time: 0.158812 Jun 14 18:04:31.699240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 437/887] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:31 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:31.805494 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:31.806194 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:31.812650 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:31.813104 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:31.813891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:31.814482 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:31.882584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-421711e2-ce3a-43a2-b801-e12d43586671 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.584121 Jun 14 18:04:31.885867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 451/888] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:04:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:04:31.896077 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-741f7025-0886-4922-ab40-c358e9eeb3a5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:31.896697 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-741f7025-0886-4922-ab40-c358e9eeb3a5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:31.973737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-741f7025-0886-4922-ab40-c358e9eeb3a5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:31.973908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:31.981600 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-741f7025-0886-4922-ab40-c358e9eeb3a5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1094 microversion: 2.1 time: 0.091984 Jun 14 18:04:31.982802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:31.984476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:31.985939 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-84175f66-fe6b-4896-8389-803a705fee69 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1740 microversion: 2.20 time: 0.184401 Jun 14 18:04:31.987121 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 438/889] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:31 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:31.991532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 452/890] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:31 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:32.716452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:32.718245 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:32.727092 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:32.727993 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:32.728978 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:32.729576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:32.863109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:32.879930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-edca2d61-b3cf-4546-8805-9719ce8e2e33 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1623 microversion: 2.1 time: 0.167018 Jun 14 18:04:32.883979 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 439/891] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:32 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1623 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:33.004799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:33.005416 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:33.007884 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-84e435af-f23f-4956-b29b-1ab98746cfa2 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:33.009086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-84e435af-f23f-4956-b29b-1ab98746cfa2 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:33.019603 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:33.024213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:33.025480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:33.026101 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:33.112751 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-84e435af-f23f-4956-b29b-1ab98746cfa2 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:33.124163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-84e435af-f23f-4956-b29b-1ab98746cfa2 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1094 microversion: 2.1 time: 0.127555 Jun 14 18:04:33.135618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 453/892] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:32 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1094 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:33.158997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-8d4cfab4-437c-4992-ac74-97ea3792507c req-c1637f85-2c4b-4cc5-8b17-bcecfde1ad02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4183d50a-65d3-47a0-90bd-ec11efad799a", "name": "network-vif-deleted", "tag": "1fcab755-2ded-49b3-bc1b-1d3480979cd3"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:33.183262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-8d4cfab4-437c-4992-ac74-97ea3792507c req-c1637f85-2c4b-4cc5-8b17-bcecfde1ad02 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:33.184478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-8d4cfab4-437c-4992-ac74-97ea3792507c req-c1637f85-2c4b-4cc5-8b17-bcecfde1ad02 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:33.210707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-8d4cfab4-437c-4992-ac74-97ea3792507c req-c1637f85-2c4b-4cc5-8b17-bcecfde1ad02 service nova] Creating event network-vif-deleted:1fcab755-2ded-49b3-bc1b-1d3480979cd3 for instance 4183d50a-65d3-47a0-90bd-ec11efad799a on hv-cinder-82635 Jun 14 18:04:33.218388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-8d4cfab4-437c-4992-ac74-97ea3792507c req-c1637f85-2c4b-4cc5-8b17-bcecfde1ad02 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064249 Jun 14 18:04:33.219872 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 454/893] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:33.277238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:33.293533 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:33.295701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:33.297611 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-32ceffdb-5a73-4047-bdb7-01f6d75c7179 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1722 microversion: 2.20 time: 0.296596 Jun 14 18:04:33.300026 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 440/894] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:32 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:34.028390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:34.029184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:34.036586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.037123 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.037993 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.038536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.071850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.072310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.072759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid 4183d50a-65d3-47a0-90bd-ec11efad799a {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:34.116983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:34.124999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6dc2589c-1730-48d3-8c15-c651095d78fc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1336 microversion: 2.1 time: 0.225023 Jun 14 18:04:34.125576 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 455/895] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:33 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1336 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:34.141669 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:34.142423 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:34.149461 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.149910 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.150951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.151418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.219356 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:34.227180 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7c698bc9-2caf-470b-b16a-4d36c8a990eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1136 microversion: 2.1 time: 0.089408 Jun 14 18:04:34.227792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 441/896] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:34 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1136 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:34.338204 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:34.338759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:34.345233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.346236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.347093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:34.347614 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:34.366233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:34.487398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:34.496636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:34.498875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:34.500156 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c5ee2948-3d1f-4ebf-88e4-136f73096aea tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1722 microversion: 2.20 time: 0.166027 Jun 14 18:04:34.500718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 456/897] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:34 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:35.143425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:35.144025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:35.146451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:35.151806 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.152670 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.153158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.153599 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.187191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.187720 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.188210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid 4183d50a-65d3-47a0-90bd-ec11efad799a {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:35.230001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:35.239053 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-59403bab-fd3e-418a-a257-e09ca40ab4ba tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 200 len: 1336 microversion: 2.1 time: 0.100163 Jun 14 18:04:35.239769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 442/898] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:35 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:35.245171 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:35.245779 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:35.253092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.255420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.255420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.255420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.318443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:35.325944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-37b7e231-afb1-4e32-b556-3641f3c268c5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1192 microversion: 2.1 time: 0.084784 Jun 14 18:04:35.326515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 457/899] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:35 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:35.518253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:35.518771 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:35.525831 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.526282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.527058 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.527529 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.663765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:35.672522 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:35.675465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:35.677455 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b61e67c8-0113-413c-9f3b-b080f8cf1199 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1725 microversion: 2.20 time: 0.162662 Jun 14 18:04:35.678785 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 443/900] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:35 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:35.699491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "092523ba-60a2-47f7-a724-ef47f3c56713"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:35.700602 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:35.707397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.707848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:35.708608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:35.709037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:36.257901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:36.258510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 4183d50a-65d3-47a0-90bd-ec11efad799a] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:36.265171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:36.265897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:36.266746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:36.267735 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:36.296385 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] HTTP exception thrown: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a could not be found. Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Request method failure captured: Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a HTTP/1.1 Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMyHLiL1wgrsiN0IALwIB4DiL_rl1UCmi-mg2SERiVU3VMVMy7zNiUbUrXqjqZ3WRs7mhLCSO8GKIZC3cA0QzEfx0dCwlnpTIafOAa8zSgTD4QtSNe95msCXz_IoL1RbsqCbvKVme-IuW41_QR75o-uPfVO4F9pp7HThPvEm3xEdHqc Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:04:36.299446 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c8e2494e0744c778b32f979005ec7ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 7f214333671e4878bf613c26ceb1381a Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a could not be found. Jun 14 18:04:36.301480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '4183d50a-65d3-47a0-90bd-ec11efad799a'} Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a could not be found. Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:04:36.302803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a could not be found. Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a could not be found. Jun 14 18:04:36.305051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:36.307474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Returning 404 to user: Instance 4183d50a-65d3-47a0-90bd-ec11efad799a could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:04:36.308367 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-74c2f0e5-96f6-4357-8ccd-52e14eab9cf0 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a" status: 404 len: 111 microversion: 2.1 time: 0.054475 Jun 14 18:04:36.308940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 444/901] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:36 2022] GET /compute/v2.1/servers/4183d50a-65d3-47a0-90bd-ec11efad799a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:04:36.319846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-19eda35a-1564-410b-b77e-f4a0261f4f47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '.version_select at 0x7fbafc0f4dc0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:36.438680 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-19eda35a-1564-410b-b77e-f4a0261f4f47 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912862043" status: 202 len: 0 microversion: 2.1 time: 0.122958 Jun 14 18:04:36.450721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 445/902] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 14 18:04:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1912862043 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:04:36.450721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:36.450721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:36.460990 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:36.461794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:36.462972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:36.463626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:36.471776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:36.558657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:36.566845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ccf9e832-072e-4d16-bd6e-89e90687f72a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1210 microversion: 2.1 time: 0.124250 Jun 14 18:04:36.567461 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 446/903] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:36 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:36.577844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-c42dffb5-816c-4d99-8be6-4f6de288b74d req-692c66da-8985-4560-b2ee-54b956cf80e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "name": "network-vif-unplugged", "status": "completed", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:36.596624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-c42dffb5-816c-4d99-8be6-4f6de288b74d req-692c66da-8985-4560-b2ee-54b956cf80e5 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:36.597495 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-c42dffb5-816c-4d99-8be6-4f6de288b74d req-692c66da-8985-4560-b2ee-54b956cf80e5 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:36.640193 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.compute.server_external_events [req-c42dffb5-816c-4d99-8be6-4f6de288b74d req-692c66da-8985-4560-b2ee-54b956cf80e5 service nova] Unable to find a host for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2. Dropping event network-vif-unplugged {{(pid=125162) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 14 18:04:36.644168 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-c42dffb5-816c-4d99-8be6-4f6de288b74d req-692c66da-8985-4560-b2ee-54b956cf80e5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.070633 Jun 14 18:04:36.645257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 447/904] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 14 18:04:37.100939 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-84ecfefc-d4ee-4946-b7c3-71c3278d3b47 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.405594 Jun 14 18:04:37.102111 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 458/905] 10.222.0.36 () {62 vars in 1363 bytes} [Tue Jun 14 18:04:35 2022] POST /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-volume_attachments => generated 188 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 14 18:04:37.250910 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:37.252367 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:37.259750 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:37.265354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:37.265354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:37.265354 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:37.585299 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:37.585748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:37.588439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:37.597048 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:37.597491 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:37.598260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:37.598695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:37.815518 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:37.823916 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-775466da-bf21-4e1f-912a-bf0544adbfed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1277 microversion: 2.1 time: 0.242800 Jun 14 18:04:37.825790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 459/906] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:37 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:38.135135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a995b22c-f7d5-4e71-b4f7-4ace3007b855 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-volume_attachments/092523ba-60a2-47f7-a724-ef47f3c56713" status: 202 len: 0 microversion: 2.20 time: 0.888757 Jun 14 18:04:38.137272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 448/907] 10.222.0.36 () {60 vars in 1456 bytes} [Tue Jun 14 18:04:37 2022] DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-volume_attachments/092523ba-60a2-47f7-a724-ef47f3c56713 => generated 0 bytes in 891 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:04:38.203438 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:38.206250 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:38.210607 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.211061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.211877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.212306 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.419913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-8031f37a-0f55-4785-ad6d-b53347a827b6 req-d98f3fbe-0bc1-4f76-9ead-77f9fde052f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c23aa6-b120-47d4-8df1-a727c3e60c85", "tag": "c5dd8b38-b5ce-41f2-89b8-59916b4e34df"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:38.430528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-8031f37a-0f55-4785-ad6d-b53347a827b6 req-d98f3fbe-0bc1-4f76-9ead-77f9fde052f9 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.430528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-8031f37a-0f55-4785-ad6d-b53347a827b6 req-d98f3fbe-0bc1-4f76-9ead-77f9fde052f9 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.442084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-8031f37a-0f55-4785-ad6d-b53347a827b6 req-d98f3fbe-0bc1-4f76-9ead-77f9fde052f9 service nova] Creating event network-changed:c5dd8b38-b5ce-41f2-89b8-59916b4e34df for instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 on hv-cinder-82635 Jun 14 18:04:38.447153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-8031f37a-0f55-4785-ad6d-b53347a827b6 req-d98f3fbe-0bc1-4f76-9ead-77f9fde052f9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104769 Jun 14 18:04:38.447780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 449/908] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:04:38.483404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-47048f33-ada9-4813-a39a-0306aee887f5 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "POST /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/action" status: 202 len: 0 microversion: 2.20 time: 0.284202 Jun 14 18:04:38.487988 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 460/909] 10.222.0.36 () {62 vars in 1318 bytes} [Tue Jun 14 18:04:38 2022] POST /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:04:38.497442 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:38.498861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:38.526946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.526946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.526946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.526946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.662200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:38.670483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:38.672011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:38.673295 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1ab82e07-b5e9-427b-a029-72bc90405ff6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1673 microversion: 2.20 time: 0.183357 Jun 14 18:04:38.679153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 450/910] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:38 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:38.842018 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:38.842633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:38.849401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.849968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.850874 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:38.851582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:38.996210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:39.004923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e3d2eb4c-ed47-4a35-b3a1-1787ce5e040f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.167232 Jun 14 18:04:39.005503 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 461/911] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:38 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:39.691932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:39.692532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:39.699346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:39.700763 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:39.700763 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:39.701344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:39.846813 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:39.855172 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:39.856745 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:39.857900 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c63a4a88-759c-4a40-8e9b-8616e87d4868 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1673 microversion: 2.20 time: 0.169878 Jun 14 18:04:39.858454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 451/912] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:39 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:40.022139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:40.022807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:40.029692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.030165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.030954 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.031476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.176377 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:40.184545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e7c80c2c-6767-4578-86dd-db6da68b47c4 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.166372 Jun 14 18:04:40.185139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 462/913] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:40 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:40.257655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:40.258195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:40.264441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.264896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.265681 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.266117 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.292979 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:04:40.302618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:40.303284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:40.309780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.310305 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.311190 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.311643 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.340767 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3b2171c7-7efa-4ff0-aa8b-cd1a29483acf tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/ips" status: 200 len: 146 microversion: 2.1 time: 0.042728 Jun 14 18:04:40.341347 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 463/914] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 18:04:40 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:04:40.638488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0d9ddf57-07e1-47b6-8531-630eb450ccfc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 204 len: 0 microversion: 2.1 time: 0.384468 Jun 14 18:04:40.639010 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 452/915] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:04:40 2022] DELETE /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:04:40.647808 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:40.648450 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:40.654809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.655267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.656069 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.656509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.856140 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:40.864510 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8c8a4991-75e3-48ad-b5a3-007484df4fff tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1509 microversion: 2.1 time: 0.220575 Jun 14 18:04:40.865070 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 464/916] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:40 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:40.878187 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:40.879041 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:40.885755 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.886218 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:40.886996 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:40.887474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:41.026753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:41.035281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:41.036808 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:41.037986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6689fd88-134a-4b21-a11e-1c790044f790 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.164803 Jun 14 18:04:41.038542 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 453/917] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:40 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:41.202866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:41.203493 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:41.206622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:41.212077 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:41.212603 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:41.213390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:41.213850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:41.592901 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:41.602308 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-31bd0f29-4e75-40f0-be63-244adf25b5cd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.403229 Jun 14 18:04:41.602890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 465/918] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:41 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:41.881809 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:41.882417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:41.889065 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:41.889516 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:41.890289 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:41.890726 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.033672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:42.041625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a5f1cd5b-9b60-400d-9073-1ceed99a9c9e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1509 microversion: 2.1 time: 0.163692 Jun 14 18:04:42.042205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 454/919] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:41 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:42.057670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:42.058109 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:42.065287 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:42.065715 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.066486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:42.066911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.069287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e46a500d-f956-4149-9c9c-ab915e20f8bd"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:42.070551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:42.076626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:42.077077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.077853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:42.078297 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.208750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:42.217839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:42.219451 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:42.221418 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-40190253-9128-489c-a6fc-2e0bfe1a8028 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.167798 Jun 14 18:04:42.222337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 466/920] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:42 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:42.619849 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:42.620456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:42.626932 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:42.627285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.628086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:42.628524 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:42.772087 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:42.779953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e30793d3-e892-484d-8e87-06bcff69e9f9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.163870 Jun 14 18:04:42.780552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 467/921] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:42 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:43.059177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:43.059854 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:43.066691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:43.067219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:43.068050 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:43.068459 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:43.121170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=10 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:43.286746 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:43.294923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1b5b2660-c2b1-4145-8bcc-3bda923d851e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1509 microversion: 2.1 time: 0.239579 Jun 14 18:04:43.295540 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 468/922] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:43 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:43.306626 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:43.307230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:43.313453 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:43.318635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:43.318635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:43.318635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:43.555068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:43.558531 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:43.563678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:43.566151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:43.567368 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f4642dc8-1c3e-4fd8-a742-0c9849aaf3c6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.264820 Jun 14 18:04:43.567930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 469/923] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:43 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:43.797551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:43.803908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:43.805485 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:43.805938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:43.806742 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:43.807183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:43.931846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-fa27ca8e-f71e-4aba-b275-3eeeff6ea58e tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.866341 Jun 14 18:04:43.946703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 455/924] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:04:42 2022] POST /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments => generated 194 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:04:44.054067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:44.070156 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-86313767-8d60-4def-9856-e303e20dd147 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.276132 Jun 14 18:04:44.071221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 470/925] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:43 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:44.103242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-49bd0e8c-f460-4411-89dc-fedef871d198 req-9ba03480-b772-4db0-b860-d5a5be309e45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c951fcf6-4f2e-44a1-a20e-9304f7e17601", "name": "network-vif-deleted", "tag": "fd70d92c-2049-469f-8632-d7ee600eb05e"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:44.112408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-49bd0e8c-f460-4411-89dc-fedef871d198 req-9ba03480-b772-4db0-b860-d5a5be309e45 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:44.113056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-49bd0e8c-f460-4411-89dc-fedef871d198 req-9ba03480-b772-4db0-b860-d5a5be309e45 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:44.124986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-49bd0e8c-f460-4411-89dc-fedef871d198 req-9ba03480-b772-4db0-b860-d5a5be309e45 service nova] Creating event network-vif-deleted:fd70d92c-2049-469f-8632-d7ee600eb05e for instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 on hv-cinder-82635 Jun 14 18:04:44.130760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-49bd0e8c-f460-4411-89dc-fedef871d198 req-9ba03480-b772-4db0-b860-d5a5be309e45 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036393 Jun 14 18:04:44.131960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 456/926] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:44.311909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:44.312583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:44.320837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:44.321325 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:44.322105 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:44.322545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:44.404117 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:44.425824 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2416fdc1-c347-4cf8-8d49-9c3ef841d4fa tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1293 microversion: 2.1 time: 0.117886 Jun 14 18:04:44.427931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 471/927] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:44 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:44.587377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:44.592332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:44.594522 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:44.595000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:44.596000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:44.596448 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:44.734049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:44.742940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:44.744624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:44.745778 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cc614c27-8aa6-4b39-94e1-4b890af1b7d8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.163380 Jun 14 18:04:44.746336 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 457/928] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:44 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:45.089315 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:45.089949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:45.104157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.105636 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.108092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.109136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.287555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:45.295270 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f0fe994c-13ee-4c7e-8e5e-abc3d7855025 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.210009 Jun 14 18:04:45.295895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 472/929] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:45 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:45.445901 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:45.446626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:45.453488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.453940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.456055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.456501 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.490791 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.491246 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.491725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:45.541191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:45.549768 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7422492f-a801-4aaa-b1bf-4f5ac8c8429e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.107618 Jun 14 18:04:45.550443 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 458/930] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:45 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:45.765010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:45.765648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:45.773288 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.773838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.774685 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:45.775196 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:45.920714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:45.929764 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:45.931402 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:45.932852 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-34780499-a732-4246-8fac-ec2c23860394 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.172201 Jun 14 18:04:45.933487 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 473/931] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:45 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:46.312735 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:46.313390 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:46.320224 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.320693 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:46.321474 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.321915 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:46.324815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:46.521881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:46.530594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4f523bc8-5c32-483d-bd26-7ccf783a1735 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.221949 Jun 14 18:04:46.531173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 459/932] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:46 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:46.567242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:46.568191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:46.574862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.575700 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:46.576680 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.577319 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:46.617384 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.617769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:46.618227 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:46.671170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:46.679498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-34061ba5-738e-4f30-a95e-1e166c4aad5b tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.116080 Jun 14 18:04:46.680081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 474/933] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:46 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:46.952678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:46.953287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:46.960384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.960872 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:46.961696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:46.962134 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:47.114877 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:47.123562 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:47.125475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:47.127669 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-aebb1f0a-b643-4f08-88d3-e2bd2f627a1c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.179331 Jun 14 18:04:47.139503 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 460/934] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:46 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:47.549339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:47.550273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:47.556889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:47.557345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:47.558131 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:47.558571 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:47.697300 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:47.697863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:47.704825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:47.705546 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:47.706734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:47.707171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:47.709079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:47.717744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2b802d91-db4a-4c9f-8f45-a1b05fd3ed62 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.172832 Jun 14 18:04:47.718686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 475/935] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:47 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:47.753036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:47.753676 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:47.754140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:47.801262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:47.809664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8fe83e67-2931-4a58-bd53-64d0e6fdaf84 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.116283 Jun 14 18:04:47.810441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 461/936] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:47 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:48.147511 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:48.148045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:48.158877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.159649 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.160606 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.161205 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.306458 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:48.316421 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:48.318179 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:48.319286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-53dc2122-e480-401d-86ef-9940b5510df8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.176077 Jun 14 18:04:48.325223 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 476/937] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:48 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:48.600653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-d98545ff-a4d3-4898-8ab4-877d890f123f req-a662f182-ac25-40a1-b6e1-c3ccb82de549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c23aa6-b120-47d4-8df1-a727c3e60c85", "name": "network-vif-plugged", "status": "completed", "tag": "c5dd8b38-b5ce-41f2-89b8-59916b4e34df"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:48.610236 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-d98545ff-a4d3-4898-8ab4-877d890f123f req-a662f182-ac25-40a1-b6e1-c3ccb82de549 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.610735 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-d98545ff-a4d3-4898-8ab4-877d890f123f req-a662f182-ac25-40a1-b6e1-c3ccb82de549 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.624494 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-d98545ff-a4d3-4898-8ab4-877d890f123f req-a662f182-ac25-40a1-b6e1-c3ccb82de549 service nova] Creating event network-vif-plugged:c5dd8b38-b5ce-41f2-89b8-59916b4e34df for instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 on hv-cinder-82635 Jun 14 18:04:48.630714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-d98545ff-a4d3-4898-8ab4-877d890f123f req-a662f182-ac25-40a1-b6e1-c3ccb82de549 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Jun 14 18:04:48.631526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 462/938] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:48.738599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:48.739947 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:48.747238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.748013 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.748950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.749527 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.831169 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:48.832637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:48.856347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.857249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.858239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.858853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.898938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:48.899828 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:48.900782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:48.951148 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:48.961728 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:48.973401 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-3c378d2b-d4d9-49eb-8a2e-4d8e699c4e86 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.148371 Jun 14 18:04:48.974136 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 463/939] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:48 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:48.974558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9a14b6ef-96a3-449f-9afb-4fb3f9a282eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.242103 Jun 14 18:04:48.983934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 477/940] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:48 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:49.339084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:49.340191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:49.347626 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:49.348381 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:49.349397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:49.350171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:49.551254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:49.570701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:49.572253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:49.573458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-671c37ad-96cc-4384-8901-9b536db8d42d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.239116 Jun 14 18:04:49.574019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 464/941] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:49 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:49.992291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:49.993731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:49.996090 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:49.997209 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:50.009311 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.009891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.012045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.012850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.017788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.018988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.020695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.021524 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.059250 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.060124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.060867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:50.112637 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:50.121146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6bd8352a-6e2b-486c-967a-571134785170 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.133703 Jun 14 18:04:50.122250 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 478/942] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:49 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:50.183855 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:50.200329 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cb1c0301-c331-4e22-a092-112dc1871e22 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.210772 Jun 14 18:04:50.202609 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 465/943] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:49 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:50.593818 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:50.594528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:50.607286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.607882 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.608761 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:50.609236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:50.814542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:50.828312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:50.831686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:50.833358 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5d31aaba-7b8a-41dc-aa1b-042805a77c24 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.243871 Jun 14 18:04:50.834316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 479/944] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:50 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:51.143027 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:51.143830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:51.153525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.154105 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:51.155158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.155802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:51.202637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.203087 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:51.203570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:51.217765 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:51.218749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:51.227924 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.228501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:51.229501 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.230034 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:51.269018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:51.277564 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6a1e5600-45dc-4ea2-9e01-87c5f8401ffc tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.139490 Jun 14 18:04:51.295202 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 466/945] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:51 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:51.426353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:51.439175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-638f27ae-5d2d-4993-8039-cb94e2c35c1a tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.224719 Jun 14 18:04:51.456084 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 480/946] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:51 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:51.852536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:51.853147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:51.861640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.862023 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:51.862826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:51.863274 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:52.020653 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:52.033074 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:52.034581 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:52.035868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-85a9f6da-415f-49ff-80ad-3ae1e50cd48c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.187313 Jun 14 18:04:52.036480 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 467/947] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:51 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:52.302331 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:52.302980 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:52.310047 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:52.310509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:52.311348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:52.312038 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:52.347061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:52.347605 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:52.348070 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:52.396587 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:52.406723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c2a3e41d-056f-42c9-9326-2c227b7761b1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.108419 Jun 14 18:04:52.407437 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 481/948] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:52 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:52.467647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:52.468415 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:52.476311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:52.476769 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:52.477554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:52.477994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:52.639680 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:52.647742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ea85c67c-e287-490b-9a08-6f9d22bc13f6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.184844 Jun 14 18:04:52.648326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 468/949] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:52 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:53.058015 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:53.059240 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:53.070004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.070824 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.072230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.073040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.235546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:53.244678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:53.246203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:53.247441 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a6ae2090-acf0-4c83-b4f5-3efcc7dc3a64 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.196156 Jun 14 18:04:53.248006 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 482/950] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:53 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:53.425896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:53.426496 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:53.433313 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.433767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.434550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.434985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.470240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.471155 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.471260 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:53.518722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:53.527276 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cca3af44-7fea-4e27-b362-951a8176bfe1 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.105975 Jun 14 18:04:53.529801 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 469/951] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:53 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:53.665574 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:53.668351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:53.673660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.674152 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.675026 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:53.675497 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:53.831345 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:53.839690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0245877c-dd57-4281-8ec5-c45823275c55 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.177918 Jun 14 18:04:53.840269 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 483/952] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:53 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:54.266086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:54.267242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:54.273551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.274093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:54.274877 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.275361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:54.411280 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:54.419685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:54.421216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:54.422610 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7c0592b0-6ca5-4e05-9512-bbf9d6f5e0c2 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.160486 Jun 14 18:04:54.423183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 470/953] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:54 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:54.544011 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:54.544622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:54.550804 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.551259 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:54.552057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.552495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:54.584888 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.593238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:54.593238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid c951fcf6-4f2e-44a1-a20e-9304f7e17601 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:04:54.627831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:54.634468 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-84028709-cb5f-46e3-9984-ef7570a2ad8f tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 200 len: 1312 microversion: 2.1 time: 0.094285 Jun 14 18:04:54.635037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 484/954] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:54 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:54.857640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:54.858201 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:54.865319 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.865774 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:54.866550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:54.866991 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.004802 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:55.012392 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6307d0b7-1c83-4a4e-99e3-b5e94c9d1b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.158944 Jun 14 18:04:55.012959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 471/955] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:54 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:55.441544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:55.442221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:55.449092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:55.449683 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.450544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:55.451093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.456065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:55.591085 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:55.599648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:55.601242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:55.602434 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-39d89b95-0900-482b-9e39-9c5ced59f3fe tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.165415 Jun 14 18:04:55.603015 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 485/956] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:55 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:55.651109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:55.651744 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: c951fcf6-4f2e-44a1-a20e-9304f7e17601] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:55.658177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:55.658642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.659448 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:55.659893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.675722 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] HTTP exception thrown: Instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 could not be found. Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Request method failure captured: Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 HTTP/1.1 Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMyHLiL1wgrsiN0IALwIB4DiL_rl1UCmi-mg2SERiVU3VMVMy7zNiUbUrXqjqZ3WRs7mhLCSO8GKIZC3cA0QzEfx0dCwlnpTIafOAa8zSgTD4QtSNe95msCXz_IoL1RbsqCbvKVme-IuW41_QR75o-uPfVO4F9pp7HThPvEm3xEdHqc Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:04:55.678232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c8e2494e0744c778b32f979005ec7ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 7f214333671e4878bf613c26ceb1381a Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 could not be found. Jun 14 18:04:55.679870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'c951fcf6-4f2e-44a1-a20e-9304f7e17601'} Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 could not be found. Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:04:55.680734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 could not be found. Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 could not be found. Jun 14 18:04:55.682322 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:04:55.689379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Returning 404 to user: Instance c951fcf6-4f2e-44a1-a20e-9304f7e17601 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:04:55.689379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f2e3a952-2750-4424-b744-4333ad36e272 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601" status: 404 len: 111 microversion: 2.1 time: 0.032783 Jun 14 18:04:55.689379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 472/957] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:55 2022] GET /compute/v2.1/servers/c951fcf6-4f2e-44a1-a20e-9304f7e17601 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:04:55.689931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:55.689931 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:55.695701 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:55.696151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.696945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:55.697364 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:55.722758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:04:56.001068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-6fd03996-3ded-4d46-8507-78322d9f0f30 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "DELETE /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 204 len: 0 microversion: 2.1 time: 0.316152 Jun 14 18:04:56.001722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 486/958] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:04:55 2022] DELETE /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:04:56.009746 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:56.010402 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:56.017198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:56.017658 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:56.018463 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:56.018905 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:56.030368 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:56.031065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:56.038333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:56.038790 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:56.039604 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:56.040047 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:56.160449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:56.174408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f9884437-5e2f-4890-91ad-fdaf9d07754e tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.168425 Jun 14 18:04:56.174997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 473/959] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:56 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:56.181041 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:56.188602 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0065876b-54ef-4af3-a553-d737321ce7de tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.162644 Jun 14 18:04:56.189665 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 487/960] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:56 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:56.621752 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:56.622282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:56.629574 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:56.630127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:56.631105 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:56.631634 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:56.765605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:56.774306 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:56.776181 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:56.777313 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-440ddc18-c460-4bea-ad19-df51894245a6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.159688 Jun 14 18:04:56.777863 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 474/961] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:56 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:57.192144 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:57.192753 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:57.199285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:57.199771 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:57.200568 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:57.200977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:57.207045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:57.207679 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:57.214177 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:57.214625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:57.215414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:57.215845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:57.335478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:57.342786 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-384a1510-0451-4897-9a2c-44bc34f1ede2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.155205 Jun 14 18:04:57.343359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 488/962] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:57 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:57.348739 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:57.351151 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=100 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:04:57.357042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a5c921a2-0270-4815-b2f9-58b1327def94 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.155178 Jun 14 18:04:57.357647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 475/963] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:57 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:57.796731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:57.797334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:57.803846 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:57.804297 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:57.805065 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:57.805500 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:57.940162 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:57.948167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:57.949788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:57.950965 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bcac1ffe-a7de-41de-89be-0945ea74754d tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.158205 Jun 14 18:04:57.951573 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 489/964] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:57 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:04:58.360353 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:58.361430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:58.368767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.369247 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:58.370032 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.370594 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:58.379905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:58.380710 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:58.388291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.388727 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:58.389704 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.390814 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:58.527330 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:58.540226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:58.544406 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b64ad9d3-22fb-4b14-8c02-b7419c334c77 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1523 microversion: 2.1 time: 0.188226 Jun 14 18:04:58.545020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 476/965] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:58 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:58.550578 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-95c72879-9c3f-4a52-846f-e95fa6690dbd req-28040b68-5d69-4f3c-8ad8-29678b8cf34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "name": "network-vif-plugged", "status": "completed", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:58.554570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-645fd428-1edb-4615-be2d-a651fdda37b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1265 microversion: 2.1 time: 0.179329 Jun 14 18:04:58.555191 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 490/966] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:58 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:58.559036 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-95c72879-9c3f-4a52-846f-e95fa6690dbd req-28040b68-5d69-4f3c-8ad8-29678b8cf34e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.559637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-95c72879-9c3f-4a52-846f-e95fa6690dbd req-28040b68-5d69-4f3c-8ad8-29678b8cf34e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:58.572239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-95c72879-9c3f-4a52-846f-e95fa6690dbd req-28040b68-5d69-4f3c-8ad8-29678b8cf34e service nova] Creating event network-vif-plugged:dfae5e13-77b4-4719-a356-b4aed071f325 for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 on hv-cinder-82635 Jun 14 18:04:58.577173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-95c72879-9c3f-4a52-846f-e95fa6690dbd req-28040b68-5d69-4f3c-8ad8-29678b8cf34e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030992 Jun 14 18:04:58.577757 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 477/967] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:58.970391 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:58.971044 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:58.977589 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.978037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:58.978806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:58.979238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.178848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:59.188027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:59.189933 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:59.191180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-aea66357-8595-44f1-875a-6302454f53e1 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.225736 Jun 14 18:04:59.192406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 491/968] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:04:58 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:04:59.565140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:59.565140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:59.572015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.572605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.573312 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.573685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.574785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:59.575567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:59.589862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.599949 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.601073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.601687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.649717 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:59.659151 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f6a3ee5d-3848-4337-a281-87a076528786 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1481 microversion: 2.1 time: 0.100699 Jun 14 18:04:59.659798 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 478/969] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:59 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1481 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:04:59.664938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-6e5d75b4-d352-4c16-917e-8fe371c9fa10 req-b81e9c95-096c-4a4e-8b33-a1927bcd22c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e01abb-08b2-4506-8fae-b466262f45e4", "name": "network-vif-deleted", "tag": "84989334-15c6-4afc-bfd1-f3a512ae930d"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:04:59.675009 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-6e5d75b4-d352-4c16-917e-8fe371c9fa10 req-b81e9c95-096c-4a4e-8b33-a1927bcd22c4 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.675482 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-6e5d75b4-d352-4c16-917e-8fe371c9fa10 req-b81e9c95-096c-4a4e-8b33-a1927bcd22c4 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.687908 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-6e5d75b4-d352-4c16-917e-8fe371c9fa10 req-b81e9c95-096c-4a4e-8b33-a1927bcd22c4 service nova] Creating event network-vif-deleted:84989334-15c6-4afc-bfd1-f3a512ae930d for instance 59e01abb-08b2-4506-8fae-b466262f45e4 on hv-cinder-82635 Jun 14 18:04:59.694039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-6e5d75b4-d352-4c16-917e-8fe371c9fa10 req-b81e9c95-096c-4a4e-8b33-a1927bcd22c4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032608 Jun 14 18:04:59.694524 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 479/970] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:04:59.763977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:59.773066 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9d9c417c-7d86-453f-bf52-84695af8b085 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1452 microversion: 2.1 time: 0.204539 Jun 14 18:04:59.773653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 492/971] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:59 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:04:59.790703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:04:59.791424 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:04:59.798493 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.799723 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.800521 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:04:59.800955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:04:59.969608 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:04:59.978667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0b11e3b6-5aef-4893-af1e-da42bd9af8ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1452 microversion: 2.1 time: 0.192145 Jun 14 18:04:59.979698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 480/972] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:04:59 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:00.211147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:00.212127 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:00.219058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.219548 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.221770 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.222315 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.306765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:00.307326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:00.314836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.315718 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.316771 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.317462 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.348426 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b5b6c1b2-300d-4769-a3be-25cbd753f892 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.045862 Jun 14 18:05:00.349794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 481/973] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 18:05:00 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:00.427822 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:00.437810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:00.440105 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:00.441476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-72a2767c-fb38-40ac-8e32-b3809509ce73 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.234453 Jun 14 18:05:00.452670 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 493/974] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:00 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:05:00.679804 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:00.680655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:00.683649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:00.689398 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.690294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.691239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.691935 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.731890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:00.732350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:00.732836 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid 59e01abb-08b2-4506-8fae-b466262f45e4 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:00.793968 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:00.802938 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-66ef97c0-5e5c-4c3f-9dd0-8d279983fee7 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1312 microversion: 2.1 time: 0.127522 Jun 14 18:05:00.803598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 482/975] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:00 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:05:01.461203 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:01.461862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:01.468904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:01.469361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:01.470388 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:01.470838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:01.636114 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:01.646541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:01.648523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:01.649742 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a203c80f-6548-4e3a-bd21-09f37bcb9db8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.192600 Jun 14 18:05:01.651029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 494/976] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:01 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:05:01.824200 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:01.824932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:01.832243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:01.832705 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:01.833560 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:01.834001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:01.868305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:01.868760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:01.869222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lazy-loading 'fault' on Instance uuid 59e01abb-08b2-4506-8fae-b466262f45e4 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:02.056261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f214333671e4878bf613c26ceb1381a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8e2494e0744c778b32f979005ec7ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:02.056261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5295e837-dfec-4ec1-ab46-5ba3eaa5e044 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 200 len: 1312 microversion: 2.1 time: 0.121029 Jun 14 18:05:02.056261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 483/977] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:01 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 1312 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:02.365181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:02.366370 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:02.374061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.374778 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.375641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.376990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.413579 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cda515cb-d5c1-4b16-95d1-2366ed232e1a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052897 Jun 14 18:05:02.414258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 495/978] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:02 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:02.418853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86674942-ccdd-45e8-af4d-0c6add329396"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:02.419956 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:02.425180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:02.425757 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:02.426919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.427392 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.428355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.428795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.434622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.434622 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.435289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.435895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.472484 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b81acccf-5cc9-4c88-986c-03250f893142 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/e46a500d-f956-4149-9c9c-ab915e20f8bd" status: 200 len: 194 microversion: 2.1 time: 0.052014 Jun 14 18:05:02.478058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 496/979] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 14 18:05:02 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/e46a500d-f956-4149-9c9c-ab915e20f8bd => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:02.605722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-2f317147-15a9-4fac-9978-d243b0897538 req-ff45b302-8267-43d2-a302-9fd8ea03a171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57c23aa6-b120-47d4-8df1-a727c3e60c85", "tag": "c5dd8b38-b5ce-41f2-89b8-59916b4e34df"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:02.616718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-2f317147-15a9-4fac-9978-d243b0897538 req-ff45b302-8267-43d2-a302-9fd8ea03a171 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.622890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-2f317147-15a9-4fac-9978-d243b0897538 req-ff45b302-8267-43d2-a302-9fd8ea03a171 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.630340 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-2f317147-15a9-4fac-9978-d243b0897538 req-ff45b302-8267-43d2-a302-9fd8ea03a171 service nova] Creating event network-changed:c5dd8b38-b5ce-41f2-89b8-59916b4e34df for instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 on hv-cinder-82635 Jun 14 18:05:02.635880 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-2f317147-15a9-4fac-9978-d243b0897538 req-ff45b302-8267-43d2-a302-9fd8ea03a171 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033737 Jun 14 18:05:02.636477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 497/980] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:02.674355 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:02.675190 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:02.685718 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.686087 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.686928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.687387 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.853183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:02.863584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:02.866059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:02.867526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-626d038d-326f-463f-91ae-e16340f817d4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1731 microversion: 2.20 time: 0.198669 Jun 14 18:05:02.871335 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 498/981] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:02 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 14 18:05:02.961328 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:02.961950 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] [instance: 59e01abb-08b2-4506-8fae-b466262f45e4] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:02.970121 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.970672 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.971698 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:02.972141 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] HTTP exception thrown: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 could not be found. Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Request method failure captured: Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 HTTP/1.1 Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMyHLiL1wgrsiN0IALwIB4DiL_rl1UCmi-mg2SERiVU3VMVMy7zNiUbUrXqjqZ3WRs7mhLCSO8GKIZC3cA0QzEfx0dCwlnpTIafOAa8zSgTD4QtSNe95msCXz_IoL1RbsqCbvKVme-IuW41_QR75o-uPfVO4F9pp7HThPvEm3xEdHqc Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:02.998120 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c8e2494e0744c778b32f979005ec7ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c8e2494e0744c778b32f979005ec7ab", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 6c8e2494e0744c778b32f979005ec7ab Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-104292196 Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 7f214333671e4878bf613c26ceb1381a Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-ServerRescueNegativeTestJSON-104292196-project Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 could not be found. Jun 14 18:05:03.004317 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '59e01abb-08b2-4506-8fae-b466262f45e4'} Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 could not be found. Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:03.006097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 could not be found. Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 could not be found. Jun 14 18:05:03.008337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:03.010079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] Returning 404 to user: Instance 59e01abb-08b2-4506-8fae-b466262f45e4 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:03.010079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2a2aa45c-b916-4664-803c-b03c504a1da2 tempest-ServerRescueNegativeTestJSON-104292196 tempest-ServerRescueNegativeTestJSON-104292196-project] 10.222.0.36 "GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4" status: 404 len: 111 microversion: 2.1 time: 0.040122 Jun 14 18:05:03.010079 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 499/982] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:02 2022] GET /compute/v2.1/servers/59e01abb-08b2-4506-8fae-b466262f45e4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:03.466977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-88e4d53e-2492-4c92-89b7-ba00adb9187d tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "POST /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.051884 Jun 14 18:05:03.473532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 484/983] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:05:02 2022] POST /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:03.886140 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:03.886866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:03.893730 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:03.894188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:03.895059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:03.895534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:04.108792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:04.118193 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:04.119751 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:04.120914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f6478bf0-0f37-4ef4-ab71-e9082583d924 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1718 microversion: 2.20 time: 0.238834 Jun 14 18:05:04.121466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 500/984] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:03 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1718 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:05:04.320818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2cefdc7-5162-47f4-9f79-4e1045dae40e"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:04.322039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:04.329697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:04.330433 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:04.331230 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:04.331704 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:05.342185 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-79e3a1ba-1808-4aa7-a944-9b605f4a2750 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "POST /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025824 Jun 14 18:05:05.351265 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 485/985] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:05:04 2022] POST /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments => generated 194 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:11.615193 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:11.615982 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:11.620852 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:11.630268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:11.630984 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:11.632442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:11.633216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:11.657692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:11.726140 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'services' on Instance uuid 4b1f5950-ab86-4273-97f5-344d55db99d7 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:12.010530 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c3f5f1d1-a28e-4ffd-8315-f2c991809210 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments/86674942-ccdd-45e8-af4d-0c6add329396" status: 202 len: 0 microversion: 2.1 time: 0.403489 Jun 14 18:05:12.011685 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 501/986] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:05:11 2022] DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments/86674942-ccdd-45e8-af4d-0c6add329396 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:12.025359 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:12.027242 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:12.034489 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:12.034946 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:12.035780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:12.036217 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:12.069494 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ba741213-5c67-4f7e-886e-34dcabddd243 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051810 Jun 14 18:05:12.070088 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 486/987] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:12 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:13.087339 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:13.088387 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:13.096247 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:13.096723 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:13.097662 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:13.098113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:13.138259 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-72b63bcc-df47-4243-bfc8-51744adf17cc tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059271 Jun 14 18:05:13.138842 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 502/988] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:13 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:14.151395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:14.152288 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:14.159221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:14.159712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:14.160536 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:14.160988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:14.192991 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-726eba87-ba4b-4b0e-871b-e1c6e8f41b5b tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045981 Jun 14 18:05:14.193592 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 487/989] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:14 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:15.204889 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:15.205677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:15.212963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:15.213414 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:15.214189 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:15.214627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:15.248519 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3ea842ee-1d20-4cb9-98b8-6d369655e772 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047890 Jun 14 18:05:15.249106 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 503/990] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:15 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:16.260889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:16.261809 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:16.269320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:16.269767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:16.270577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:16.271017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:16.302671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-cbf341f8-9d20-422a-983d-6b1729e8d0f9 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045693 Jun 14 18:05:16.303256 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 488/991] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:16 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:17.315164 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:17.316137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:17.323007 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:17.323541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:17.324333 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:17.324773 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:17.355561 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0578ee98-74da-43c6-9c20-8637f2cd6014 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Jun 14 18:05:17.357248 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 504/992] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:17 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:18.369204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:18.370059 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:18.377638 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:18.378116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:18.378916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:18.379390 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:18.413873 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e89cc1ab-c8b5-47d2-8d07-7be0a96e0bf1 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048842 Jun 14 18:05:18.414461 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 489/993] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:18 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:19.425850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:19.426783 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:19.439004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:19.439853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:19.441283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:19.442061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:19.480251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-39d24adf-3809-465c-bc94-9e80b879f4aa tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058458 Jun 14 18:05:19.480853 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 505/994] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:19 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:20.382605 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:20.383718 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:20.391005 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.391697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.396282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.396282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.429590 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:20.437088 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e4512264-aecd-44d9-ad8b-3d9334b69090 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058694 Jun 14 18:05:20.437689 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 490/995] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:20 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:20.494149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:20.495155 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:20.502979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.503460 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.504251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.504691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.538652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2b0a27af-1a8b-4b32-9232-4aa5eb179710 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049282 Jun 14 18:05:20.539234 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 506/996] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:20 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:20.583947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:20.584582 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:20.595640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.596197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.597182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.597701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.630960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a1f3b04d-9206-479f-b069-f0f8fbe97622 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/e46a500d-f956-4149-9c9c-ab915e20f8bd" status: 200 len: 194 microversion: 2.1 time: 0.051291 Jun 14 18:05:20.631641 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 491/997] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 14 18:05:20 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/e46a500d-f956-4149-9c9c-ab915e20f8bd => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:20.642023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:20.642439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:20.649443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.650034 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.650692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:20.651426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:20.749312 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lazy-loading 'services' on Instance uuid 1c7de29b-12b3-439a-a994-5eada188817d {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:21.039653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e2a3705d-f06f-4da0-9777-939bc9f2271f tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/e46a500d-f956-4149-9c9c-ab915e20f8bd" status: 202 len: 0 microversion: 2.1 time: 0.401380 Jun 14 18:05:21.040395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 507/998] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:05:20 2022] DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/e46a500d-f956-4149-9c9c-ab915e20f8bd => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:21.551248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:21.552834 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:21.561417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:21.561876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:21.562672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:21.563148 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:21.601276 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e45fa8d2-91d5-47af-8f15-5bc8359081e2 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054971 Jun 14 18:05:21.601959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 492/999] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:21 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:05:21.669458 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:21.670057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:21.677166 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:21.677683 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:21.678466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:21.678898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:21.707226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:05:22.246945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-447728a7-6a64-4b5b-92b3-ccdd6ac0de47 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 204 len: 0 microversion: 2.1 time: 0.581843 Jun 14 18:05:22.247872 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 508/1000] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:21 2022] DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:05:22.257607 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:22.258216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:22.265344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:22.265793 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:22.266580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:22.268358 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:22.422396 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:22.430887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-67a67771-3a9b-448e-8e7c-15d8ff28e10c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1682 microversion: 2.1 time: 0.177143 Jun 14 18:05:22.431497 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 493/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:22 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:23.235133 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:23.236479 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:23.243365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:23.243823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:23.244605 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:23.245044 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:23.279541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-302acbca-4773-4076-8518-59afa9b4404d tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/c2cefdc7-5162-47f4-9f79-4e1045dae40e" status: 200 len: 194 microversion: 2.1 time: 0.048579 Jun 14 18:05:23.280158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 509/1002] 10.222.0.36 () {58 vars in 1412 bytes} [Tue Jun 14 18:05:23 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/c2cefdc7-5162-47f4-9f79-4e1045dae40e => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:23.291015 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:23.291895 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:23.299579 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:23.300123 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:23.300941 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:23.301386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:23.413939 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lazy-loading 'services' on Instance uuid 1c7de29b-12b3-439a-a994-5eada188817d {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:23.450650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:23.451398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:23.462284 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:23.462746 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:23.463671 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:23.464111 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:23.644074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:23.654563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7ace520b-1922-44f9-93d5-639e46a8d77a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1682 microversion: 2.1 time: 0.208148 Jun 14 18:05:23.655183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 510/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:23 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1682 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:23.695063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bb4e2cb0-ac40-4059-b29f-52daa2ce3cb7 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/c2cefdc7-5162-47f4-9f79-4e1045dae40e" status: 202 len: 0 microversion: 2.1 time: 0.407601 Jun 14 18:05:23.696294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 494/1004] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:05:23 2022] DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments/c2cefdc7-5162-47f4-9f79-4e1045dae40e => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:24.676585 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:24.677283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:24.684053 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:24.684419 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:24.685460 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:24.685630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:24.933968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:24.943321 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3d995672-8ad8-4f21-9bdb-6f0d2838a021 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1682 microversion: 2.1 time: 0.271241 Jun 14 18:05:24.943927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 511/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:24 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1682 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:25.463199 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-8f2c2a4e-58e9-4f70-803f-036884481714 req-f3177eea-86b7-47f8-b433-6844b32cd160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b1f5950-ab86-4273-97f5-344d55db99d7", "name": "network-vif-deleted", "tag": "7385caf6-a8e2-4117-95cb-dfcb0100cd45"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:25.473320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-8f2c2a4e-58e9-4f70-803f-036884481714 req-f3177eea-86b7-47f8-b433-6844b32cd160 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:25.474004 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-8f2c2a4e-58e9-4f70-803f-036884481714 req-f3177eea-86b7-47f8-b433-6844b32cd160 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:25.584798 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-8f2c2a4e-58e9-4f70-803f-036884481714 req-f3177eea-86b7-47f8-b433-6844b32cd160 service nova] Creating event network-vif-deleted:7385caf6-a8e2-4117-95cb-dfcb0100cd45 for instance 4b1f5950-ab86-4273-97f5-344d55db99d7 on hv-cinder-82635 Jun 14 18:05:25.590640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-8f2c2a4e-58e9-4f70-803f-036884481714 req-f3177eea-86b7-47f8-b433-6844b32cd160 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131895 Jun 14 18:05:25.591235 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 495/1006] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:25.962022 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:25.963856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:25.973860 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:25.974415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:25.976226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:25.976780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.020900 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.021977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.022458 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lazy-loading 'fault' on Instance uuid 4b1f5950-ab86-4273-97f5-344d55db99d7 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:26.067583 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:26.069268 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:26.079089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.080825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.081904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.082344 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.114867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c7ab182f1fd41718376a8e2f03ec87c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '865c9f495fc24f8fb216d11917309a95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:26.118128 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-81f3c2a1-9d78-4764-b1da-88e97025ce68 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057061 Jun 14 18:05:26.124476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 496/1007] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:26 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:05:26.135970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9eb38bb3-aa4d-4f42-9b4b-28cda5327d00 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 200 len: 1331 microversion: 2.1 time: 0.177660 Jun 14 18:05:26.137023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 512/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:25 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 1331 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:26.274580 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:26.276484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:26.292825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.293643 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.294930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.295765 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.335386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c8953ca3-603d-4422-be87-dcc9203cd699 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069156 Jun 14 18:05:26.335898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 497/1009] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:05:26 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:05:26.470952 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:26.471914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:26.478942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.479726 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.480536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.481402 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.515124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:05:26.554699 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:26.854720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a6bde60c-5abf-4655-ba7d-652e63c86f28 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 204 len: 0 microversion: 2.1 time: 0.387703 Jun 14 18:05:26.855226 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 513/1010] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:26 2022] DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:05:26.865780 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:26.866449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:26.874069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.874628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:26.875553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:26.876510 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:27.040767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:27.049977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-31e3748a-05c9-4345-abaf-7ecf299d73b0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1675 microversion: 2.1 time: 0.188578 Jun 14 18:05:27.050687 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 498/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:26 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:27.159420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:27.160627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:27.173575 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:27.174617 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:27.180415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:27.181257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:27.198745 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 HTTP/1.1 Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:27.200534 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:27.209254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '4b1f5950-ab86-4273-97f5-344d55db99d7'} Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:27.210632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:27.211981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:27.213213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:27.213213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4963b955-04da-40bc-a695-f5a2d890f18e tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 404 len: 111 microversion: 2.1 time: 0.050975 Jun 14 18:05:27.213213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 514/1012] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:27 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:27.218140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ae172265-78a9-4cba-a6f2-34a1d18d4fe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '.version_select at 0x7fbafc19bb80>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:27.315180 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ae172265-78a9-4cba-a6f2-34a1d18d4fe8 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144962738" status: 202 len: 0 microversion: 2.1 time: 0.104759 Jun 14 18:05:27.315881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 499/1013] 10.222.0.36 () {58 vars in 1217 bytes} [Tue Jun 14 18:05:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144962738 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:28.076648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:28.076648 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:28.077531 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:28.078267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:28.079619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:28.080095 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:28.306871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:28.317360 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4e62563a-46a7-4919-bb15-c471016dbfbe tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1675 microversion: 2.1 time: 0.252021 Jun 14 18:05:28.318053 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 515/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:28 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:29.336703 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:29.337671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:29.345375 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:29.345915 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:29.346967 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:29.347548 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:29.565844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:29.574204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4776bd4b-9e33-4d2c-9411-1716be8ef51c tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1675 microversion: 2.1 time: 0.242290 Jun 14 18:05:29.575039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 500/1015] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:29 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1675 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:29.745344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:29.753115 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:29.754944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:29.755504 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:29.756334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:29.756819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:29.773956 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 HTTP/1.1 Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:29.775792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.778292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '4b1f5950-ab86-4273-97f5-344d55db99d7'} Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:29.779132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.783748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.790564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:29.790564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-55002754-4e19-454b-b575-77e07136bc53 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 404 len: 111 microversion: 2.1 time: 0.038239 Jun 14 18:05:29.790564 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 516/1016] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:29 2022] DELETE /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:29.792369 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:29.793438 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b1f5950-ab86-4273-97f5-344d55db99d7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:29.804934 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:29.804934 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:29.806000 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:29.806706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:29.859969 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 HTTP/1.1 Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:29.862526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.867987 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '4b1f5950-ab86-4273-97f5-344d55db99d7'} Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:29.868943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. Jun 14 18:05:29.870425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:29.871523 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 4b1f5950-ab86-4273-97f5-344d55db99d7 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:29.871523 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-de7c276d-9ae1-4487-97c9-c5b84b3e9de5 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7" status: 404 len: 111 microversion: 2.1 time: 0.078644 Jun 14 18:05:29.871523 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 501/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:29 2022] GET /compute/v2.1/servers/4b1f5950-ab86-4273-97f5-344d55db99d7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:30.152463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-eee9c9bc-44fe-41ab-bd6b-ff657f635d5e req-6baac72c-a26e-4172-a422-1e9697d40b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7de29b-12b3-439a-a994-5eada188817d", "name": "network-vif-deleted", "tag": "2d358ed7-706f-4cd0-a87a-d21304bfb6b6"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:30.176484 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-eee9c9bc-44fe-41ab-bd6b-ff657f635d5e req-6baac72c-a26e-4172-a422-1e9697d40b3f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:30.177282 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-eee9c9bc-44fe-41ab-bd6b-ff657f635d5e req-6baac72c-a26e-4172-a422-1e9697d40b3f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:30.193472 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-eee9c9bc-44fe-41ab-bd6b-ff657f635d5e req-6baac72c-a26e-4172-a422-1e9697d40b3f service nova] Creating event network-vif-deleted:2d358ed7-706f-4cd0-a87a-d21304bfb6b6 for instance 1c7de29b-12b3-439a-a994-5eada188817d on hv-cinder-82635 Jun 14 18:05:30.199575 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-eee9c9bc-44fe-41ab-bd6b-ff657f635d5e req-6baac72c-a26e-4172-a422-1e9697d40b3f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050644 Jun 14 18:05:30.200512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 517/1018] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:30.595251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:30.596441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:30.629747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:30.630593 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:30.635171 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:30.642479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:30.706550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:30.707293 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:30.707878 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lazy-loading 'fault' on Instance uuid 1c7de29b-12b3-439a-a994-5eada188817d {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:30.780803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41680577c34d4b9090270d3097a7e02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2bf6c7727884fd98fd7035f04de2da5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:30.791349 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-75f64e4f-8e09-48e0-992e-154586c10fc4 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 200 len: 1328 microversion: 2.1 time: 0.202649 Jun 14 18:05:30.792198 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 502/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:30 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 1328 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:31.380523 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:31.383157 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:31.390811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.391497 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.392967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.393551 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.419986 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 HTTP/1.1 Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:31.422235 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.425154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '4b39a9a6-8711-4f93-9a26-7d1f05e71af8'} Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:31.426599 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.428397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.430068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:31.430068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a6761687-3d3e-4474-af6e-35747555c61c tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 404 len: 111 microversion: 2.1 time: 0.052712 Jun 14 18:05:31.430068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 518/1020] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:31 2022] DELETE /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:31.437176 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:31.437964 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 4b39a9a6-8711-4f93-9a26-7d1f05e71af8] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:31.450019 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.450532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.467861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.467861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.480753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 HTTP/1.1 Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:31.483766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.485792 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '4b39a9a6-8711-4f93-9a26-7d1f05e71af8'} Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:31.486694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. Jun 14 18:05:31.488034 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.489127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 4b39a9a6-8711-4f93-9a26-7d1f05e71af8 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:31.489127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-57e22948-49a8-4812-b7a3-65a5c9aba17a tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8" status: 404 len: 111 microversion: 2.1 time: 0.053734 Jun 14 18:05:31.490237 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 503/1021] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:31 2022] GET /compute/v2.1/servers/4b39a9a6-8711-4f93-9a26-7d1f05e71af8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:31.497632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:31.498386 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:31.506895 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.507480 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.508280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.508745 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.525468 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 HTTP/1.1 Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:31.527812 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.538963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2'} Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:31.540566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.542983 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.545513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:31.545513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-82d1a9c5-aa4c-4a59-983e-744118292fdd tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 404 len: 111 microversion: 2.1 time: 0.035808 Jun 14 18:05:31.545513 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 519/1022] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:31 2022] DELETE /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:31.547136 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:31.548541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:31.556999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.557556 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.558451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.558984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.589314 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 HTTP/1.1 Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:31.591896 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.594577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2'} Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:31.597066 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. Jun 14 18:05:31.599700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.603257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:31.603257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-01f6bc6b-65d8-4d6f-85f8-c6098d3cef35 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2" status: 404 len: 111 microversion: 2.1 time: 0.059264 Jun 14 18:05:31.603257 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 504/1023] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:31 2022] GET /compute/v2.1/servers/5bcaf844-e50a-4aa9-8eeb-cdd5cc99e6d2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:31.818512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:31.819188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:31.828315 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.828836 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.829945 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:31.830401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:31.845997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] HTTP exception thrown: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Request method failure captured: Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d HTTP/1.1 Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxGwE3GxoWdy0dEFNY8aUqh0fZdeZ7I55cz8wRNMuNvCZesew3JDksY-zklRIMORK_DPNLaTRorfMySeR_qfWKqGxua-V5sMS1M8X_PziCNLG90x7rQjqorklBST4_5I7CDNAyogMdNM_XBEhPLMt6koVkFgpp-FEkwQ2USyERgwnk Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:31.847785 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2bf6c7727884fd98fd7035f04de2da5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 41680577c34d4b9090270d3097a7e02c Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:31.862181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '1c7de29b-12b3-439a-a994-5eada188817d'} Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:31.865590 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:31.872925 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:31.879445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Returning 404 to user: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:31.879445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-95c7e64b-0ba7-4070-914b-290a6e5276d5 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 404 len: 111 microversion: 2.1 time: 0.035984 Jun 14 18:05:31.879445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 520/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:31 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:31.879675 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8f2e46e9-f972-46ce-9ef4-f09c8c53b528 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '.version_select at 0x7fbafc19b8b0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:31.974215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8f2e46e9-f972-46ce-9ef4-f09c8c53b528 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459676628" status: 202 len: 0 microversion: 2.1 time: 0.119668 Jun 14 18:05:31.975403 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 505/1025] 10.222.0.36 () {58 vars in 1220 bytes} [Tue Jun 14 18:05:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1459676628 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:33.084706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:33.087375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:33.105976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:33.105976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:33.105976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:33.105976 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:33.124074 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 HTTP/1.1 Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:33.125760 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.127439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '97278dbc-a791-43fb-b077-cd4f0a0bebf7'} Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:33.128526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.129994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.133136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:33.133136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ce2ea0ec-c637-46d4-8459-c236967adff3 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 404 len: 111 microversion: 2.1 time: 0.047534 Jun 14 18:05:33.133136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 521/1026] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:33 2022] DELETE /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:33.138589 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:33.139212 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] [instance: 97278dbc-a791-43fb-b077-cd4f0a0bebf7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:33.141226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:33.150714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:33.151728 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:33.155341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:33.155906 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:33.180566 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] HTTP exception thrown: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Request method failure captured: Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 HTTP/1.1 Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxDVss_Al8c38hYO1t-XVHe6abLwp80btdOc1J3ABEg3ntAHGPZOMBrPOT2kC_V9lmI3EMhGCG6JfWzdOIE5M172q2mlNZ6E3_8NwVHXgRaK2weE9g4Stm98Nr47aAI3DTvcdqoA-I47HxYobl1YKeIQs7H4HgGcrioniuL2LpUEHw Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:33.182270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/865c9f495fc24f8fb216d11917309a95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_865c9f495fc24f8fb216d11917309a95", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 865c9f495fc24f8fb216d11917309a95 Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-541256978 Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 9c7ab182f1fd41718376a8e2f03ec87c Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeNegativeTest-541256978-project Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.183955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '97278dbc-a791-43fb-b077-cd4f0a0bebf7'} Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:33.184890 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. Jun 14 18:05:33.186892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:33.188684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] Returning 404 to user: Instance 97278dbc-a791-43fb-b077-cd4f0a0bebf7 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:33.188684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d9057746-bf0b-4500-893a-180a743f40a7 tempest-AttachVolumeNegativeTest-541256978 tempest-AttachVolumeNegativeTest-541256978-project] 10.222.0.36 "GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7" status: 404 len: 111 microversion: 2.1 time: 0.051157 Jun 14 18:05:33.188684 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 506/1027] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:33 2022] GET /compute/v2.1/servers/97278dbc-a791-43fb-b077-cd4f0a0bebf7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:34.628887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-aef13531-7651-4b1d-973f-f3d5c0d6fd0e req-7148c671-e768-47b1-93b9-1c83aa31af57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:34.632080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:34.632080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:34.643693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:34.644725 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:34.646439 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:34.647600 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:34.651761 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-aef13531-7651-4b1d-973f-f3d5c0d6fd0e req-7148c671-e768-47b1-93b9-1c83aa31af57 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:34.652213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-aef13531-7651-4b1d-973f-f3d5c0d6fd0e req-7148c671-e768-47b1-93b9-1c83aa31af57 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:34.682484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-aef13531-7651-4b1d-973f-f3d5c0d6fd0e req-7148c671-e768-47b1-93b9-1c83aa31af57 service nova] Creating event network-changed:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:05:34.701597 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-aef13531-7651-4b1d-973f-f3d5c0d6fd0e req-7148c671-e768-47b1-93b9-1c83aa31af57 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077119 Jun 14 18:05:34.702928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 507/1028] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:34.734742 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:05:35.184126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2cb2e93f-6b97-4833-ac86-957ffb7fb8df tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "DELETE /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 204 len: 0 microversion: 2.1 time: 0.563318 Jun 14 18:05:35.185422 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 522/1029] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:34 2022] DELETE /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:05:35.201157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:35.208360 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:35.221842 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:35.222648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:35.224161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:35.225020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:35.672951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:35.686001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d9d9f2f9-3261-43b1-a258-60e98667ef63 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.493240 Jun 14 18:05:35.686596 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 508/1030] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:35 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:36.349094 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:36.351038 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:36.364454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:36.365291 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:36.366938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:36.367741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:36.399693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] HTTP exception thrown: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Request method failure captured: Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d HTTP/1.1 Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxGwE3GxoWdy0dEFNY8aUqh0fZdeZ7I55cz8wRNMuNvCZesew3JDksY-zklRIMORK_DPNLaTRorfMySeR_qfWKqGxua-V5sMS1M8X_PziCNLG90x7rQjqorklBST4_5I7CDNAyogMdNM_XBEhPLMt6koVkFgpp-FEkwQ2USyERgwnk Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:36.403678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2bf6c7727884fd98fd7035f04de2da5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 41680577c34d4b9090270d3097a7e02c Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.405405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '1c7de29b-12b3-439a-a994-5eada188817d'} Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:36.406449 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.408979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.410413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Returning 404 to user: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:36.410413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-10874359-a080-42e5-97af-5270abdc226a tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 404 len: 111 microversion: 2.1 time: 0.067184 Jun 14 18:05:36.410580 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 523/1031] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:36 2022] DELETE /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:36.426889 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:36.428305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: 1c7de29b-12b3-439a-a994-5eada188817d] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:36.443207 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:36.445847 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:36.446758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:36.447734 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] HTTP exception thrown: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Request method failure captured: Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d HTTP/1.1 Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxGwE3GxoWdy0dEFNY8aUqh0fZdeZ7I55cz8wRNMuNvCZesew3JDksY-zklRIMORK_DPNLaTRorfMySeR_qfWKqGxua-V5sMS1M8X_PziCNLG90x7rQjqorklBST4_5I7CDNAyogMdNM_XBEhPLMt6koVkFgpp-FEkwQ2USyERgwnk Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:36.476001 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2bf6c7727884fd98fd7035f04de2da5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 41680577c34d4b9090270d3097a7e02c Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.478930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '1c7de29b-12b3-439a-a994-5eada188817d'} Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:36.480395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. Jun 14 18:05:36.483147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:36.486682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Returning 404 to user: Instance 1c7de29b-12b3-439a-a994-5eada188817d could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:36.488182 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-34adbd19-e17e-437d-b1ff-e3dc4b4d0f95 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d" status: 404 len: 111 microversion: 2.1 time: 0.071234 Jun 14 18:05:36.495330 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 509/1032] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:36 2022] GET /compute/v2.1/servers/1c7de29b-12b3-439a-a994-5eada188817d => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:36.713168 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:36.714169 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:36.722362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:36.722818 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:36.723919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:36.724418 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:37.196810 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:37.212855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-01c3b36b-e18b-4702-acda-90d00799b317 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1564 microversion: 2.1 time: 0.503849 Jun 14 18:05:37.213819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 524/1033] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:36 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1564 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:05:37.750110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:37.752639 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:37.762331 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:37.762778 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:37.763951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:37.764394 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:37.823211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-eed1a19b-cf04-47a6-ab16-3bd311126487 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077060 Jun 14 18:05:37.823905 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 510/1034] 10.222.0.36 () {60 vars in 1342 bytes} [Tue Jun 14 18:05:37 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:37.959793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:37.959793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:37.971649 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.015474 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.015474 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.015943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:38.016052 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.016141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:38.016141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.016141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.016141 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.017080 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.017175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] HTTP exception thrown: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Request method failure captured: Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 HTTP/1.1 Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxGwE3GxoWdy0dEFNY8aUqh0fZdeZ7I55cz8wRNMuNvCZesew3JDksY-zklRIMORK_DPNLaTRorfMySeR_qfWKqGxua-V5sMS1M8X_PziCNLG90x7rQjqorklBST4_5I7CDNAyogMdNM_XBEhPLMt6koVkFgpp-FEkwQ2USyERgwnk Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:38.017320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2bf6c7727884fd98fd7035f04de2da5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 41680577c34d4b9090270d3097a7e02c Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.019186 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'd2412cb1-a36e-4e84-92d7-ca0c179b6993'} Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:38.020040 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.021395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.022751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Returning 404 to user: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:38.022751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8a61ed8c-fd9c-426d-8dbf-ec55be3a6fb0 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 404 len: 111 microversion: 2.1 time: 0.056048 Jun 14 18:05:38.022751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 511/1035] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:05:37 2022] DELETE /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:38.032043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:38.032771 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] [instance: d2412cb1-a36e-4e84-92d7-ca0c179b6993] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:38.040718 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.041559 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.042654 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.043195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.061124 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] HTTP exception thrown: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Request method failure captured: Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 HTTP/1.1 Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxGwE3GxoWdy0dEFNY8aUqh0fZdeZ7I55cz8wRNMuNvCZesew3JDksY-zklRIMORK_DPNLaTRorfMySeR_qfWKqGxua-V5sMS1M8X_PziCNLG90x7rQjqorklBST4_5I7CDNAyogMdNM_XBEhPLMt6koVkFgpp-FEkwQ2USyERgwnk Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:38.062853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/b2bf6c7727884fd98fd7035f04de2da5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_b2bf6c7727884fd98fd7035f04de2da5", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: b2bf6c7727884fd98fd7035f04de2da5 Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1658352157 Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 41680577c34d4b9090270d3097a7e02c Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeTestJSON-1658352157-project Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.065830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'd2412cb1-a36e-4e84-92d7-ca0c179b6993'} Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:38.068239 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. Jun 14 18:05:38.070891 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:38.074988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] Returning 404 to user: Instance d2412cb1-a36e-4e84-92d7-ca0c179b6993 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:38.074988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-97b4d596-4602-4476-9d02-223752a57549 tempest-AttachVolumeTestJSON-1658352157 tempest-AttachVolumeTestJSON-1658352157-project] 10.222.0.36 "GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993" status: 404 len: 111 microversion: 2.1 time: 0.038236 Jun 14 18:05:38.074988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 512/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:38 2022] GET /compute/v2.1/servers/d2412cb1-a36e-4e84-92d7-ca0c179b6993 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:38.234168 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:38.235116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:38.242072 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.242637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.243629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.244197 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.425307 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:38.453667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-57df63be-756c-43e0-9561-75c2f0ffc024 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1446 microversion: 2.1 time: 0.223809 Jun 14 18:05:38.465980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 513/1037] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:38 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1446 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:05:38.561993 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-5b774d53-aed5-403b-8653-e9428bbf69a9 req-e38a9a7d-15fc-4e56-bea1-6fcc1f2a041f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ef92a3-eec9-4d0c-8dd4-df9d964902b9", "name": "network-vif-deleted", "tag": "0ff66b61-b9a4-476c-a9b6-dc562208abc4"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:38.596143 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-5b774d53-aed5-403b-8653-e9428bbf69a9 req-e38a9a7d-15fc-4e56-bea1-6fcc1f2a041f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.596952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-5b774d53-aed5-403b-8653-e9428bbf69a9 req-e38a9a7d-15fc-4e56-bea1-6fcc1f2a041f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.627934 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-5b774d53-aed5-403b-8653-e9428bbf69a9 req-e38a9a7d-15fc-4e56-bea1-6fcc1f2a041f service nova] Creating event network-vif-deleted:0ff66b61-b9a4-476c-a9b6-dc562208abc4 for instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 on hv-cinder-82635 Jun 14 18:05:38.636639 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-5b774d53-aed5-403b-8653-e9428bbf69a9 req-e38a9a7d-15fc-4e56-bea1-6fcc1f2a041f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080120 Jun 14 18:05:38.637710 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 514/1038] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:38.712948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7d8db95c-f0bf-452a-b8ea-02b73561ca4c tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 204 len: 0 microversion: 2.20 time: 0.758473 Jun 14 18:05:38.713981 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 525/1039] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 14 18:05:37 2022] DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 18:05:38.727113 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:38.728294 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:38.737614 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.738436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.740544 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:38.741233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:38.746713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:39.123680 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:39.133561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:39.135472 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:39.137614 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1304a1d7-ed3c-4b7b-816c-fcdf51ef8af4 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.414800 Jun 14 18:05:39.138184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 515/1040] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:38 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:05:39.480729 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:39.481505 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:39.490545 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:39.490996 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:39.491875 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:39.492496 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:39.606908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:39.617520 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-28866f28-682f-485c-a87d-26f3f6e1027b tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1217 microversion: 2.1 time: 0.141517 Jun 14 18:05:39.628364 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 526/1041] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:39 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:05:40.159255 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:40.160263 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:40.168007 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:40.168460 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:40.169528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:40.170258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:40.356477 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:40.379783 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:40.387045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:40.387045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-17911a4d-b8d0-48a2-9e16-72789962b95f tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.228909 Jun 14 18:05:40.387045 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 516/1042] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:40 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:05:40.637547 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:40.638486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:40.659743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:40.659743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:40.659743 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:40.663541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:40.703494 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:40.704304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:40.705650 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lazy-loading 'fault' on Instance uuid 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:05:40.995262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6b1c08311384aa39ad01a8378c9a056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add35554d0514dc59890c61894593313', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:41.019150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f7da9637-ec6c-416e-960a-d21d37ccccbe tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 200 len: 1222 microversion: 2.1 time: 0.384966 Jun 14 18:05:41.019635 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 527/1043] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:40 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 1222 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:05:41.405226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:41.406404 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:41.415693 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:41.416145 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:41.416945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:41.417377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:41.592154 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:41.601410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:41.603314 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:41.604707 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d6656ff8-4382-4a9b-a85d-2f4680494bc6 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1724 microversion: 2.20 time: 0.204092 Jun 14 18:05:41.605795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 517/1044] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:41 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:05:42.041366 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:42.044123 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] [instance: 07ef92a3-eec9-4d0c-8dd4-df9d964902b9] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:42.051368 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:05:42.058942 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:42.060310 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:42.061707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:42.062558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:42.091280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] HTTP exception thrown: Instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 could not be found. Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Request method failure captured: Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 HTTP/1.1 Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMydQ8iqy0brncvhBapJqxagRAietcR37cXDGrfcz9pfJ2wGbLbzN1QfNm53l55KPP_ojH-yiqpFvSmOJTfnm7U-uKiDTrE5luBwxmWRB7EMYaynNXvSegvOtnPvI5OUFe8Z6_BehkHGMPBeZ_m_cnuc3RaH88xKY9k9lCetqEFZLbw Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: add35554d0514dc59890c61894593313 Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-TestShelveInstance-1226271299 Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:42.096542 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/add35554d0514dc59890c61894593313"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/add35554d0514dc59890c61894593313"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/add35554d0514dc59890c61894593313"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_add35554d0514dc59890c61894593313", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-TestShelveInstance-1226271299 Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: add35554d0514dc59890c61894593313 Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-TestShelveInstance-1226271299 Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-TestShelveInstance-1226271299-project Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: e6b1c08311384aa39ad01a8378c9a056 Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-TestShelveInstance-1226271299-project Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 could not be found. Jun 14 18:05:42.099146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '07ef92a3-eec9-4d0c-8dd4-df9d964902b9'} Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 could not be found. Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:42.100690 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 could not be found. Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 could not be found. Jun 14 18:05:42.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:42.108424 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Returning 404 to user: Instance 07ef92a3-eec9-4d0c-8dd4-df9d964902b9 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:42.111215 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b51ed5f0-f696-447f-9794-c432f6c63477 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9" status: 404 len: 111 microversion: 2.1 time: 0.075637 Jun 14 18:05:42.135425 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 528/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:05:42 2022] GET /compute/v2.1/servers/07ef92a3-eec9-4d0c-8dd4-df9d964902b9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:42.435871 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-6dd5bc0b-bab3-4753-96b7-1397193b2998 req-5d26838f-23c1-4853-b54e-0b9e3e6c726d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f04acf5-db93-42a3-8950-c3ccccca5db2", "name": "network-vif-deleted", "tag": "dfae5e13-77b4-4719-a356-b4aed071f325"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:42.498476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-6dd5bc0b-bab3-4753-96b7-1397193b2998 req-5d26838f-23c1-4853-b54e-0b9e3e6c726d service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:42.499881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-6dd5bc0b-bab3-4753-96b7-1397193b2998 req-5d26838f-23c1-4853-b54e-0b9e3e6c726d service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:42.536081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-6dd5bc0b-bab3-4753-96b7-1397193b2998 req-5d26838f-23c1-4853-b54e-0b9e3e6c726d service nova] Creating event network-vif-deleted:dfae5e13-77b4-4719-a356-b4aed071f325 for instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 on hv-cinder-82635 Jun 14 18:05:42.567984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-6dd5bc0b-bab3-4753-96b7-1397193b2998 req-5d26838f-23c1-4853-b54e-0b9e3e6c726d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133383 Jun 14 18:05:42.572158 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 518/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:42.630062 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:42.631289 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:42.651547 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:42.653997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:42.658465 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:42.658465 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:42.771937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:42.782789 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:42.784373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0b64d79cbd27413cb9d6064e7b9c88e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b2ba814064d7da5702f0f15d1ba0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:05:42.785880 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9a09703c-efc7-4aaf-a987-0b2642e2fac8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 200 len: 1365 microversion: 2.20 time: 0.166095 Jun 14 18:05:42.796870 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 529/1047] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:42 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 14 18:05:42.920122 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-96799c8c-3b5b-4fb8-88ee-906eed3aa057 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] Calling method '.version_select at 0x7fbafc24ee50>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:43.081117 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-96799c8c-3b5b-4fb8-88ee-906eed3aa057 tempest-TestShelveInstance-1226271299 tempest-TestShelveInstance-1226271299-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-922967960" status: 202 len: 0 microversion: 2.1 time: 0.198648 Jun 14 18:05:43.083258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 519/1048] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-922967960 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:43.814038 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:43.815769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:43.838061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:43.838543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:43.839762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:43.840212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:43.880158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] HTTP exception thrown: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Request method failure captured: Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 HTTP/1.1 Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxANii8mTGJg1LW6xmfim3cmfSBeWqUfhmqRm80YBkJdKuM1TeBWDCAm4iSlwF1goW7arNgbIMDalvJkPMBFpguTfg2tpW125g3yJokRnoGap9TLEtcrBwWJD-RwCT3m_8e7A3EJBoRdQ4awDjppircXQObG488o_vgzd6H_8kwgcQ Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:43.883476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61b2ba814064d7da5702f0f15d1ba0a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 0b64d79cbd27413cb9d6064e7b9c88e7 Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:43.894967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '9f04acf5-db93-42a3-8950-c3ccccca5db2'} Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:43.895774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:43.897153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:43.898281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Returning 404 to user: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:43.898281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9291f55b-d4e2-4d8e-a303-a0a876fde13e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 404 len: 111 microversion: 2.20 time: 0.085116 Jun 14 18:05:43.898281 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 530/1049] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:43 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:05:43.899825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-84fe4a94-7353-4cfa-b83f-348caa454909 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '.version_select at 0x7fbafc19f940>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:44.080374 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-84fe4a94-7353-4cfa-b83f-348caa454909 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-684080610" status: 204 len: 0 microversion: 2.20 time: 0.183971 Jun 14 18:05:44.081052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 520/1050] 10.222.0.36 () {60 vars in 1258 bytes} [Tue Jun 14 18:05:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-684080610 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 14 18:05:44.626031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-227fd785-0e93-474f-b9ff-1330eb2bad17 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Action: 'create', calling method: .version_select at 0x7fbafca5ef70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-916648889"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:45.532597 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-227fd785-0e93-474f-b9ff-1330eb2bad17 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.159848 Jun 14 18:05:45.536873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 531/1051] 10.222.0.36 () {60 vars in 1154 bytes} [Tue Jun 14 18:05:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1162 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 14 18:05:45.544691 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-c840ebd8-fb28-4497-af32-2bc723ff3a8c tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc3b3700>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:45.643093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-c840ebd8-fb28-4497-af32-2bc723ff3a8c tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 200 len: 344 microversion: 2.1 time: 0.100353 Jun 14 18:05:45.652953 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 521/1052] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 18:05:45 2022] GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:46.667420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-348191e3-2c37-486c-b5ff-c85a01b5f15b tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafcad9b80>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:46.765845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-348191e3-2c37-486c-b5ff-c85a01b5f15b tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 200 len: 345 microversion: 2.1 time: 0.108208 Jun 14 18:05:46.775216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 532/1053] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 18:05:46 2022] GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:46.780160 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-50d9ce4e-2a35-4d69-8cc3-a93bfc1110ba tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Action: 'create', calling method: .version_select at 0x7fbafc24e670>, body: {"snapshot": {"volume_id": "beca1fd1-2f62-4879-8072-efa7856715c3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1934993491"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:05:47.242597 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:47.244170 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:47.255175 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:47.255831 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:47.258183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:47.258183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:47.283612 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] HTTP exception thrown: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Request method failure captured: Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 HTTP/1.1 Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxANii8mTGJg1LW6xmfim3cmfSBeWqUfhmqRm80YBkJdKuM1TeBWDCAm4iSlwF1goW7arNgbIMDalvJkPMBFpguTfg2tpW125g3yJokRnoGap9TLEtcrBwWJD-RwCT3m_8e7A3EJBoRdQ4awDjppircXQObG488o_vgzd6H_8kwgcQ Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:47.285652 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61b2ba814064d7da5702f0f15d1ba0a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 0b64d79cbd27413cb9d6064e7b9c88e7 Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.296341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '9f04acf5-db93-42a3-8950-c3ccccca5db2'} Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:47.298374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.300172 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.301631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Returning 404 to user: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:47.301631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a820dd65-fe3a-417a-95f2-e2efb32f20e8 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 404 len: 111 microversion: 2.20 time: 0.050625 Jun 14 18:05:47.301631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 533/1054] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 14 18:05:47 2022] DELETE /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:05:47.309396 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:47.310292 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 9f04acf5-db93-42a3-8950-c3ccccca5db2] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:47.319085 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:47.319777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:47.320951 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:47.321568 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:47.341105 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] HTTP exception thrown: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Request method failure captured: Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 HTTP/1.1 Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqMxANii8mTGJg1LW6xmfim3cmfSBeWqUfhmqRm80YBkJdKuM1TeBWDCAm4iSlwF1goW7arNgbIMDalvJkPMBFpguTfg2tpW125g3yJokRnoGap9TLEtcrBwWJD-RwCT3m_8e7A3EJBoRdQ4awDjppircXQObG488o_vgzd6H_8kwgcQ Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:47.346381 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61b2ba814064d7da5702f0f15d1ba0a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: 0b64d79cbd27413cb9d6064e7b9c88e7 Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.348406 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '9f04acf5-db93-42a3-8950-c3ccccca5db2'} Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:47.349304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. Jun 14 18:05:47.350784 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:47.352147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Returning 404 to user: Instance 9f04acf5-db93-42a3-8950-c3ccccca5db2 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:47.352147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d06a9b42-a709-4ad9-a980-8aba2cc1809e tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2" status: 404 len: 111 microversion: 2.20 time: 0.041723 Jun 14 18:05:47.352147 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 534/1055] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:47 2022] GET /compute/v2.1/servers/9f04acf5-db93-42a3-8950-c3ccccca5db2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:05:47.385859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-50d9ce4e-2a35-4d69-8cc3-a93bfc1110ba tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.610201 Jun 14 18:05:47.386782 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 522/1056] 10.222.0.36 () {60 vars in 1161 bytes} [Tue Jun 14 18:05:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:05:47.399560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3c85acf9-c93d-457d-831a-a4fdcb3618e4 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafca63ee0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:47.451734 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3c85acf9-c93d-457d-831a-a4fdcb3618e4 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 200 len: 287 microversion: 2.1 time: 0.056672 Jun 14 18:05:47.457702 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 535/1057] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:47 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:47.464527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8dfa9b69-4a6e-4298-a8dd-9e3fdbe0e42d tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc19b310>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:47.518620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8dfa9b69-4a6e-4298-a8dd-9e3fdbe0e42d tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.059093 Jun 14 18:05:47.522282 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 523/1058] 10.222.0.36 () {58 vars in 1139 bytes} [Tue Jun 14 18:05:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:47.535219 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9c30b30e-f7dd-489b-b1f4-21f9000666a7 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafca5ef70>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:47.601139 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9c30b30e-f7dd-489b-b1f4-21f9000666a7 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 200 len: 287 microversion: 2.1 time: 0.071578 Jun 14 18:05:47.601782 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 536/1059] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:47 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:48.615953 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-49991532-3b24-41c6-a31e-ecf7c12ef742 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc24e0d0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:48.665471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-49991532-3b24-41c6-a31e-ecf7c12ef742 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 200 len: 287 microversion: 2.1 time: 0.056077 Jun 14 18:05:48.666384 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 524/1060] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:48 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:49.680304 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-98c3c3b0-f989-4b0a-ac0d-0f1abae4f759 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc785790>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:49.721798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-98c3c3b0-f989-4b0a-ac0d-0f1abae4f759 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 200 len: 287 microversion: 2.1 time: 0.047183 Jun 14 18:05:49.729819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 537/1061] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:49 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:50.734561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b2e67672-12e8-4136-9c2e-5aa195cbdf73 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc3b3e50>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:50.785304 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b2e67672-12e8-4136-9c2e-5aa195cbdf73 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 200 len: 288 microversion: 2.1 time: 0.054937 Jun 14 18:05:50.787279 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 525/1062] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:50 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:50.799593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cfa29838-1a54-42db-9618-2901b3bc7027 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafca500d0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:50.922055 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:50.923561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:50.933076 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:50.933526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:50.934319 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:50.934756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:50.952328 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] HTTP exception thrown: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Request method failure captured: Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd HTTP/1.1 Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxANii8mTGJg1LW6xmfim3cmfSBeWqUfhmqRm80YBkJdKuM1TeBWDCAm4iSlwF1goW7arNgbIMDalvJkPMBFpguTfg2tpW125g3yJokRnoGap9TLEtcrBwWJD-RwCT3m_8e7A3EJBoRdQ4awDjppircXQObG488o_vgzd6H_8kwgcQ Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:50.954248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61b2ba814064d7da5702f0f15d1ba0a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 0b64d79cbd27413cb9d6064e7b9c88e7 Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:50.956110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '105cfea1-617b-4c5a-b63a-df8eda1907bd'} Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:50.956897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:50.958164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:50.959518 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Returning 404 to user: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:50.959518 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ea131982-905e-4b5d-8309-9aa52ab98297 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 404 len: 111 microversion: 2.20 time: 0.039804 Jun 14 18:05:50.959518 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 526/1063] 10.222.0.36 () {60 vars in 1279 bytes} [Tue Jun 14 18:05:50 2022] DELETE /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 14 18:05:50.967142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:50.967985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] [instance: 105cfea1-617b-4c5a-b63a-df8eda1907bd] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:05:50.986682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:50.986682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:50.986682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:05:50.986682 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:05:50.987013 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cfa29838-1a54-42db-9618-2901b3bc7027 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 202 len: 0 microversion: 2.1 time: 0.187080 Jun 14 18:05:50.987013 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 538/1064] 10.222.0.36 () {58 vars in 1253 bytes} [Tue Jun 14 18:05:50 2022] DELETE /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:50.992807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1bc2e089-6efb-4bcd-887d-be8eb7ad7077 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafcb2c550>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:50.996958 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] HTTP exception thrown: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Request method failure captured: Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd HTTP/1.1 Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqMxANii8mTGJg1LW6xmfim3cmfSBeWqUfhmqRm80YBkJdKuM1TeBWDCAm4iSlwF1goW7arNgbIMDalvJkPMBFpguTfg2tpW125g3yJokRnoGap9TLEtcrBwWJD-RwCT3m_8e7A3EJBoRdQ4awDjppircXQObG488o_vgzd6H_8kwgcQ Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Openstack-Nova-Api-Version: 2.20 Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:50.998729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61b2ba814064d7da5702f0f15d1ba0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61b2ba814064d7da5702f0f15d1ba0a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: f61b2ba814064d7da5702f0f15d1ba0a Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-462488987 Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: 0b64d79cbd27413cb9d6064e7b9c88e7 Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-AttachVolumeShelveTestJSON-462488987-project Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:51.000527 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '105cfea1-617b-4c5a-b63a-df8eda1907bd'} Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:51.001380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. Jun 14 18:05:51.002799 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:51.005251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] Returning 404 to user: Instance 105cfea1-617b-4c5a-b63a-df8eda1907bd could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:51.005251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-479f9209-a9a3-4089-8ff1-529aad11a568 tempest-AttachVolumeShelveTestJSON-462488987 tempest-AttachVolumeShelveTestJSON-462488987-project] 10.222.0.36 "GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd" status: 404 len: 111 microversion: 2.20 time: 0.038058 Jun 14 18:05:51.005251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 527/1065] 10.222.0.36 () {60 vars in 1276 bytes} [Tue Jun 14 18:05:50 2022] GET /compute/v2.1/servers/105cfea1-617b-4c5a-b63a-df8eda1907bd => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 14 18:05:51.046978 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1bc2e089-6efb-4bcd-887d-be8eb7ad7077 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 200 len: 287 microversion: 2.1 time: 0.056875 Jun 14 18:05:51.046978 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 539/1066] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:50 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:52.064826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-be25ad1f-3bfe-411e-a5bc-1e434f70835a tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc19b820>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:52.317350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-be25ad1f-3bfe-411e-a5bc-1e434f70835a tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] HTTP exception thrown: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-be25ad1f-3bfe-411e-a5bc-1e434f70835a tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Request method failure captured: Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd HTTP/1.1 Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqM34eDFSNNcfSu2O7kg1mx9OrL8C8RQkv1uBRAMEKt5N9BrHxfzO3O8BMwm4yw71ikw0xzmKebW-PPWBQ0NRWTQ1Kp9YAJezdZVAGWNiI71yypuhq1AIsgX2GPhu19A3n9l3zLZs3fBzzlqLacSBBRnEw4VwwykQq0rGUGOQJMeFRqU Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:52.320625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25f56991b4c14ffca55aca08105b04a4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: f83b97d3b451488fa7bb2cdb900e62d3 Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'f7bde2b5-5cb8-4b5f-a8cb-608db509eabd'} Jun 14 18:05:52.326047 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. (HTTP 404) (Request-ID: req-68dddbbd-7453-4852-a31a-a7f007cf32c9) Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.326995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:05:52.328240 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 14 18:05:52.330078 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-be25ad1f-3bfe-411e-a5bc-1e434f70835a tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Returning 404 to user: Snapshot f7bde2b5-5cb8-4b5f-a8cb-608db509eabd could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:52.331584 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-be25ad1f-3bfe-411e-a5bc-1e434f70835a tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd" status: 404 len: 111 microversion: 2.1 time: 0.266092 Jun 14 18:05:52.332563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 528/1067] 10.222.0.36 () {58 vars in 1250 bytes} [Tue Jun 14 18:05:52 2022] GET /compute/v2.1/os-snapshots/f7bde2b5-5cb8-4b5f-a8cb-608db509eabd => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:52.333759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-87b840d9-97c4-4afd-9b0d-14ce09488966 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafd48b9d0>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:52.709437 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-87b840d9-97c4-4afd-9b0d-14ce09488966 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 202 len: 0 microversion: 2.1 time: 0.380930 Jun 14 18:05:52.713097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 540/1068] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 18:05:52 2022] DELETE /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:05:52.724528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d78a1632-7501-483e-875e-ad0c44fefe28 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc19b820>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:52.790213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d78a1632-7501-483e-875e-ad0c44fefe28 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 200 len: 344 microversion: 2.1 time: 0.075269 Jun 14 18:05:52.790784 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 529/1069] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 18:05:52 2022] GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:05:53.807934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ceaf72d4-8a6d-448e-93ec-a99084fadf01 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafcada310>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:53.914953 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-ceaf72d4-8a6d-448e-93ec-a99084fadf01 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] HTTP exception thrown: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ceaf72d4-8a6d-448e-93ec-a99084fadf01 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Request method failure captured: Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 HTTP/1.1 Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqM34eDFSNNcfSu2O7kg1mx9OrL8C8RQkv1uBRAMEKt5N9BrHxfzO3O8BMwm4yw71ikw0xzmKebW-PPWBQ0NRWTQ1Kp9YAJezdZVAGWNiI71yypuhq1AIsgX2GPhu19A3n9l3zLZs3fBzzlqLacSBBRnEw4VwwykQq0rGUGOQJMeFRqU Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:53.917546 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25f56991b4c14ffca55aca08105b04a4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: f83b97d3b451488fa7bb2cdb900e62d3 Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': 'beca1fd1-2f62-4879-8072-efa7856715c3'} Jun 14 18:05:53.919256 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. (HTTP 404) (Request-ID: req-d7cc7491-68e9-4d7c-a6a2-5b7bbfa02e4c) Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:53.920621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:05:53.921917 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 18:05:53.924201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:53.925456 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:53.927739 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-ceaf72d4-8a6d-448e-93ec-a99084fadf01 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Returning 404 to user: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:53.928807 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-ceaf72d4-8a6d-448e-93ec-a99084fadf01 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 404 len: 109 microversion: 2.1 time: 0.126684 Jun 14 18:05:53.929584 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 541/1070] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 18:05:53 2022] GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:05:53.959153 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-735444c6-0e81-4d66-89d7-c790fcf6bca0 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafc0e14c0>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:54.166462 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-735444c6-0e81-4d66-89d7-c790fcf6bca0 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] HTTP exception thrown: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-735444c6-0e81-4d66-89d7-c790fcf6bca0 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Request method failure captured: Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 HTTP/1.1 Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqM34eDFSNNcfSu2O7kg1mx9OrL8C8RQkv1uBRAMEKt5N9BrHxfzO3O8BMwm4yw71ikw0xzmKebW-PPWBQ0NRWTQ1Kp9YAJezdZVAGWNiI71yypuhq1AIsgX2GPhu19A3n9l3zLZs3fBzzlqLacSBBRnEw4VwwykQq0rGUGOQJMeFRqU Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:05:54.168526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25f56991b4c14ffca55aca08105b04a4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: f83b97d3b451488fa7bb2cdb900e62d3 Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': 'beca1fd1-2f62-4879-8072-efa7856715c3'} Jun 14 18:05:54.170376 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. (HTTP 404) (Request-ID: req-ff8640d8-06d9-4dce-b1ba-b671f1eca93a) Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:54.171450 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 14 18:05:54.173475 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 14 18:05:54.175332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-735444c6-0e81-4d66-89d7-c790fcf6bca0 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Returning 404 to user: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:54.177234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-735444c6-0e81-4d66-89d7-c790fcf6bca0 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 404 len: 109 microversion: 2.1 time: 0.222023 Jun 14 18:05:54.180281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 530/1071] 10.222.0.36 () {58 vars in 1247 bytes} [Tue Jun 14 18:05:53 2022] DELETE /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 109 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:05:54.185036 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a1ce76d7-8b07-40c1-8471-de79b15d03d5 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Calling method '.version_select at 0x7fbafca5e700>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:05:54.247749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-a1ce76d7-8b07-40c1-8471-de79b15d03d5 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] HTTP exception thrown: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a1ce76d7-8b07-40c1-8471-de79b15d03d5 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Request method failure captured: Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 HTTP/1.1 Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqM34eDFSNNcfSu2O7kg1mx9OrL8C8RQkv1uBRAMEKt5N9BrHxfzO3O8BMwm4yw71ikw0xzmKebW-PPWBQ0NRWTQ1Kp9YAJezdZVAGWNiI71yypuhq1AIsgX2GPhu19A3n9l3zLZs3fBzzlqLacSBBRnEw4VwwykQq0rGUGOQJMeFRqU Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:05:54.249955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/25f56991b4c14ffca55aca08105b04a4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_25f56991b4c14ffca55aca08105b04a4", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: 25f56991b4c14ffca55aca08105b04a4 Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1200214564 Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: f83b97d3b451488fa7bb2cdb900e62d3 Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1200214564-project Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': 'beca1fd1-2f62-4879-8072-efa7856715c3'} Jun 14 18:05:54.252928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. (HTTP 404) (Request-ID: req-81891753-68b0-4773-8b6a-14168ae344d9) Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:54.253966 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 14 18:05:54.255348 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 14 18:05:54.257477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. Jun 14 18:05:54.259043 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:05:54.262930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a1ce76d7-8b07-40c1-8471-de79b15d03d5 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] Returning 404 to user: Volume beca1fd1-2f62-4879-8072-efa7856715c3 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:05:54.262930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a1ce76d7-8b07-40c1-8471-de79b15d03d5 tempest-VolumesSnapshotsTestJSON-1200214564 tempest-VolumesSnapshotsTestJSON-1200214564-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3" status: 404 len: 109 microversion: 2.1 time: 0.081663 Jun 14 18:05:54.263717 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 542/1072] 10.222.0.36 () {58 vars in 1244 bytes} [Tue Jun 14 18:05:54 2022] GET /compute/v2.1/os-volumes/beca1fd1-2f62-4879-8072-efa7856715c3 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:06:45.454618 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:06:45.460324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Tue Jun 14 18:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:06:57.678397 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:06:57.679051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:06:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:07:00.443012 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:00.445051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=23 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:00.449326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:00.450222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:00.456392 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:00.456839 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:00.457880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:00.458030 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:00.495698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:07:00.934261 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d2d2fa20-ad5b-4252-a220-d9abeca50b8f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 204 len: 0 microversion: 2.1 time: 0.491940 Jun 14 18:07:00.938577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 531/1073] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:07:00 2022] DELETE /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:07:00.943585 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=9 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:00.946997 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:00.953923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:00.955601 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:00.962738 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:00.967463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:00.967463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:00.967463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:01.125922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:01.134369 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0247b84b-42b1-481e-a545-d92bdab94613 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1576 microversion: 2.1 time: 0.193812 Jun 14 18:07:01.135428 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 543/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:00 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:02.157410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:02.158373 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:02.172258 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:02.173736 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:02.182444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:02.182444 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:02.291632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-633971873", "imageRef": "e926391c-ee6e-466c-a4a7-bae8bc9d455f", "flavorRef": "452"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:02.372938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] validate_networks() for None {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:07:02.381839 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:02.391178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7dc290b3-bc97-48bf-aa0f-b6436eb75c63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1576 microversion: 2.1 time: 0.241927 Jun 14 18:07:02.391917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 532/1075] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:02 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1576 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:02.817395 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:07:02.817834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:07:02.819272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:07:02.819879 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:07:02.820303 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:07:02.830891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:02.831383 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:02.832212 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:02.832659 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:02.854211 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Getting quotas for project bab9329cb961497f9923d611541a4d17. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:07:02.862275 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Getting quotas for user ad2bc23473c147e4b7ae8dcef1ae58ca and project bab9329cb961497f9923d611541a4d17. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:07:02.882745 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:07:02.885632 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e926391c-ee6e-466c-a4a7-bae8bc9d455f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:07:03.051218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-163d6111-4806-4cd5-bd9f-db898ed2115c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765144 Jun 14 18:07:03.052535 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 544/1076] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:07:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:07:03.064303 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d6007709-8f89-4c4b-b69c-7a76854a310b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:03.065281 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d6007709-8f89-4c4b-b69c-7a76854a310b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:03.128111 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d6007709-8f89-4c4b-b69c-7a76854a310b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:03.137898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d6007709-8f89-4c4b-b69c-7a76854a310b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1214 microversion: 2.1 time: 0.077870 Jun 14 18:07:03.138458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 533/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:03 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:03.410848 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:03.411486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:03.419000 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:03.420167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:03.420968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:03.421410 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:03.640633 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:03.656762 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d3c0df08-53c1-4d55-b63e-bd33b9cc4f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1576 microversion: 2.1 time: 0.250144 Jun 14 18:07:03.657911 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 545/1078] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:03 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1576 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:04.162289 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5e6426a5-8fea-4ca8-bad6-f35ea245a939 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:04.162922 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5e6426a5-8fea-4ca8-bad6-f35ea245a939 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:04.222443 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5e6426a5-8fea-4ca8-bad6-f35ea245a939 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:04.232468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5e6426a5-8fea-4ca8-bad6-f35ea245a939 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1214 microversion: 2.1 time: 0.075946 Jun 14 18:07:04.237483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 534/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:04 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:04.334445 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-7deabf18-fbf5-4ffd-b2b7-e5ede7aa33e3 req-230f749c-96d8-4393-a80e-23951a405251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57c23aa6-b120-47d4-8df1-a727c3e60c85", "name": "network-vif-deleted", "tag": "c5dd8b38-b5ce-41f2-89b8-59916b4e34df"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:04.347016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-7deabf18-fbf5-4ffd-b2b7-e5ede7aa33e3 req-230f749c-96d8-4393-a80e-23951a405251 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:04.350274 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-7deabf18-fbf5-4ffd-b2b7-e5ede7aa33e3 req-230f749c-96d8-4393-a80e-23951a405251 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:04.362769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-7deabf18-fbf5-4ffd-b2b7-e5ede7aa33e3 req-230f749c-96d8-4393-a80e-23951a405251 service nova] Creating event network-vif-deleted:c5dd8b38-b5ce-41f2-89b8-59916b4e34df for instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 on hv-cinder-82635 Jun 14 18:07:04.369092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-7deabf18-fbf5-4ffd-b2b7-e5ede7aa33e3 req-230f749c-96d8-4393-a80e-23951a405251 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037939 Jun 14 18:07:04.370264 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 546/1080] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:07:04.686439 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:04.688468 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:04.696247 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:04.696697 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:04.698041 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:04.698041 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:04.786770 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:04.796625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-a7147fdc-e290-45f7-836b-334e70ef84b7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1225 microversion: 2.1 time: 0.116572 Jun 14 18:07:04.803347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 535/1081] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:04 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:05.258200 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:05.259138 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:05.273240 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:05.276740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:05.278430 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:05.278977 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:05.379585 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:05.388905 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-837c4429-0504-4520-9eb2-870a27050264 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1210 microversion: 2.1 time: 0.137678 Jun 14 18:07:05.390108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 547/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:05 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1210 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:05.819355 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:05.821008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:05.834760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:05.835673 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:05.836914 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:05.838194 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:05.898649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:05.899454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:05.900747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.objects.instance [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lazy-loading 'fault' on Instance uuid 57c23aa6-b120-47d4-8df1-a727c3e60c85 {{(pid=125162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:07:05.969747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:05.985248 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-72be2980-dbef-4760-bd7f-4b4dc6d796dc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 200 len: 1230 microversion: 2.1 time: 0.169874 Jun 14 18:07:05.987661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 536/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:05 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 1230 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:06.418242 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:06.419344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:06.439344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:06.441617 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:06.443038 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:06.446108 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:06.561153 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:06.579286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a1cc46da-9366-4340-a3aa-a94bba50a636 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1274 microversion: 2.1 time: 0.168059 Jun 14 18:07:06.591818 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 548/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:06 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:07.006287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:07.006995 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:07.020947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:07.021721 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:07.023038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:07.023585 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:07.042340 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] HTTP exception thrown: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Request method failure captured: Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 HTTP/1.1 Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqM2NF0kgqSvv1eajE_xO5bfj28yI9nhjLpWtv0V7E58RgMnaPTN_g3R0Wop2T2x2bHys0ybedm2lsSmqUvkZZQbYpeoz8zLebxOn-tBwT0WeywNcv8BBLL7oRkSc6y76TfDXX4QrpODjK90HWrs1IvUBVdz34_KpXNeWKwdnuJzDu3g Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: f61370c4497b496487383283e474bc3a Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:07:07.044796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61370c4497b496487383283e474bc3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61370c4497b496487383283e474bc3a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: f61370c4497b496487383283e474bc3a Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: da59091825d44440887d6ef9c542b1ce Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:07:07.057795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '57c23aa6-b120-47d4-8df1-a727c3e60c85'} Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:07:07.064572 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:07:07.069189 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:07:07.072464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Returning 404 to user: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:07:07.072464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-08c79058-8d6c-4d58-903b-d9a8fcd4defd tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 404 len: 111 microversion: 2.1 time: 0.044730 Jun 14 18:07:07.072464 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 537/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:07 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:07:07.194528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1162966428", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930342607", "security_groups": [{"name": "tempest-secgroup-smoke-163578328"}], "block_device_mapping_v2": [{"uuid": "4fa9f864-4836-4bb5-b472-f4f7ec6d8408", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77be5dba-7c4d-415d-be45-9164b79f49bd"}]}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:07.394575 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.network.neutron [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] validate_networks() for [('77be5dba-7c4d-415d-be45-9164b79f49bd', None, None, None, None, None)] {{(pid=125161) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:07:07.614821 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:07.615693 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:07.626990 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:07.627997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:07.629236 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:07.629868 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:07.732231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:07.742084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-6b1350ee-64fa-47f7-abed-db187d8dda49 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1272 microversion: 2.1 time: 0.134501 Jun 14 18:07:07.743453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 538/1086] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:07 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:08.140686 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Flavor limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:07:08.141554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Image limits 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:07:08.142315 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Flavor pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:07:08.143056 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Image pref 0:0:0 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:07:08.143629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.virt.hardware [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125161) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:07:08.168902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:08.170285 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:08.173057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:08.174963 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:08.218392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for project f61370c4497b496487383283e474bc3a. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:07:08.229181 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for user da59091825d44440887d6ef9c542b1ce and project f61370c4497b496487383283e474bc3a. Resources: {'instances', 'cores', 'ram'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:07:08.318873 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Going to run 1 instances... {{(pid=125161) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:07:08.319522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4fa9f864-4836-4bb5-b472-f4f7ec6d8408',volume_size=None,volume_type=None)] {{(pid=125161) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:07:08.760817 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:08.761437 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:08.770947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:08.771421 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:08.772211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:08.772652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:08.845692 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-974c67b8-41e3-4a1a-a2bf-3d5c917ee7bc tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.655034 Jun 14 18:07:08.846951 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 549/1087] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:07:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 14 18:07:08.867639 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3b9b8118-5e7c-47d3-b0ab-1902713e9e4c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:08.879141 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3b9b8118-5e7c-47d3-b0ab-1902713e9e4c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:09.059357 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:09.084972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1c90c521-3292-4842-9af2-941162938f4e tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.328089 Jun 14 18:07:09.086206 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 539/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:08 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:09.092150 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3b9b8118-5e7c-47d3-b0ab-1902713e9e4c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:09.100673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3b9b8118-5e7c-47d3-b0ab-1902713e9e4c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1095 microversion: 2.1 time: 0.246274 Jun 14 18:07:09.110780 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 550/1089] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:08 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1095 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:09.352776 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-cd64058c-4107-44ab-9a23-e84791da3481 req-f567969e-e395-40ee-b86b-d7e859d4f6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2bfe57-011a-4218-9b1b-4c7caa6f25c7", "tag": "b9ad1e25-8399-492a-b7a0-7b3f3b82fe49"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:09.378743 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-cd64058c-4107-44ab-9a23-e84791da3481 req-f567969e-e395-40ee-b86b-d7e859d4f6eb service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:09.379545 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-cd64058c-4107-44ab-9a23-e84791da3481 req-f567969e-e395-40ee-b86b-d7e859d4f6eb service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:09.413541 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-cd64058c-4107-44ab-9a23-e84791da3481 req-f567969e-e395-40ee-b86b-d7e859d4f6eb service nova] Creating event network-changed:b9ad1e25-8399-492a-b7a0-7b3f3b82fe49 for instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 on hv-cinder-82635 Jun 14 18:07:09.427521 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-cd64058c-4107-44ab-9a23-e84791da3481 req-f567969e-e395-40ee-b86b-d7e859d4f6eb service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083696 Jun 14 18:07:09.429210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 540/1090] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:07:10.107230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:10.108101 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:10.119701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:10.125280 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:10.125968 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:10.126192 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:10.127160 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:10.127854 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:10.132909 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:10.133936 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:10.135819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:10.136611 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:10.242254 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:10.251592 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d1832b98-ae45-4fbe-b743-32703cf1cd20 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1145 microversion: 2.1 time: 0.136874 Jun 14 18:07:10.253140 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 541/1091] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:10 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1145 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:10.327389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:10.336137 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-10487ad5-50d3-4ec7-91bf-9fbaa41abb23 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.235052 Jun 14 18:07:10.336748 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 551/1092] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:10 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:11.278515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:11.279138 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:11.286093 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:11.286544 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:11.287379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:11.287845 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:11.355528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:11.355920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:11.357917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:11.363037 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:11.363668 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:11.364497 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:11.365033 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:11.365924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f944f48f-c4c0-4671-b0bc-38c52ece44ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1145 microversion: 2.1 time: 0.091952 Jun 14 18:07:11.366508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 542/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:11 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:11.519097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:11.527869 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5c3b7940-3e58-4e1b-af38-8c43fe3a6311 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.176581 Jun 14 18:07:11.528766 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 552/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:11 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:12.387174 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:12.387823 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:12.394997 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:12.395484 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:12.396272 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:12.396943 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:12.482656 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:12.491738 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7f9b58bd-7393-417f-abc5-8492957eee96 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1145 microversion: 2.1 time: 0.109295 Jun 14 18:07:12.498640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 543/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:12 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1145 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:12.551758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:12.552595 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:12.562640 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:12.563871 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:12.564664 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:12.565411 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:12.756799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:12.765057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-83625260-900e-4ca3-a646-fb0379044adc tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.218285 Jun 14 18:07:12.765767 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 553/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:12 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:13.516201 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:13.516840 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:13.524339 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:13.525334 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:13.526395 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:13.526853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:13.596152 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:13.607235 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-376b1e85-9a77-43c5-af2e-146ecd831645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1137 microversion: 2.1 time: 0.095020 Jun 14 18:07:13.607882 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 544/1097] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:13 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:13.785972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:13.786823 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:13.797747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:13.798324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:13.799047 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:13.799787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:13.961154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:13.971031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2c2b621c-a064-405e-8e52-300a289a9a20 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.191637 Jun 14 18:07:13.971678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 554/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:13 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:14.630195 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:14.630768 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:14.632897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=4 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:14.638695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:14.645601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:14.645601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:14.645601 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:14.702977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:14.710883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-78035227-d7b8-4406-9728-6532962befd8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1193 microversion: 2.1 time: 0.084722 Jun 14 18:07:14.711482 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 545/1099] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:14 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:14.989799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:14.990462 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:14.998990 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:14.999478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:15.000254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:15.000765 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:15.149940 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:15.159515 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cf901824-fdd6-498a-a0bc-08d0f8717d0a tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.173645 Jun 14 18:07:15.160113 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 555/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:14 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:15.729552 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:15.730148 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:15.737833 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:15.738285 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:15.739075 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:15.739553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:15.811476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:15.819492 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1c1873c5-f7cd-4d8f-b938-279c5f875432 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1193 microversion: 2.1 time: 0.094915 Jun 14 18:07:15.820084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 546/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:15 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:16.177774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:16.178430 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:16.186334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:16.189528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:16.189528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:16.189528 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:16.339566 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:16.349411 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b3178bbd-f472-4794-b723-60c9fc1e1acb tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.175842 Jun 14 18:07:16.350398 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 556/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:16 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:16.839463 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:16.840452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:16.850096 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:16.850709 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:16.851761 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:16.852760 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:16.937598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:16.951685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7a81db70-dad1-438e-8a6e-4681cd659170 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1211 microversion: 2.1 time: 0.118413 Jun 14 18:07:16.954712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 547/1103] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:16 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:17.104201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-b7adc5e3-7866-45d1-ba9c-ba9e8a18e3ef req-df832ed1-0548-491c-a09a-0811d5ec600b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2bfe57-011a-4218-9b1b-4c7caa6f25c7", "name": "network-vif-plugged", "status": "completed", "tag": "b9ad1e25-8399-492a-b7a0-7b3f3b82fe49"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:17.113277 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-b7adc5e3-7866-45d1-ba9c-ba9e8a18e3ef req-df832ed1-0548-491c-a09a-0811d5ec600b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:17.113731 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-b7adc5e3-7866-45d1-ba9c-ba9e8a18e3ef req-df832ed1-0548-491c-a09a-0811d5ec600b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:17.127230 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-b7adc5e3-7866-45d1-ba9c-ba9e8a18e3ef req-df832ed1-0548-491c-a09a-0811d5ec600b service nova] Creating event network-vif-plugged:b9ad1e25-8399-492a-b7a0-7b3f3b82fe49 for instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 on hv-cinder-82635 Jun 14 18:07:17.132834 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-b7adc5e3-7866-45d1-ba9c-ba9e8a18e3ef req-df832ed1-0548-491c-a09a-0811d5ec600b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032487 Jun 14 18:07:17.133756 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 557/1104] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:07:17.378534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:17.378534 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:17.381923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:17.382377 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:17.383323 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:17.383767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:17.637764 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:17.642803 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:17.651102 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-b39080f8-78d3-4ab4-8dd9-ab93759fc059 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.279876 Jun 14 18:07:17.652454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 548/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:17 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:17.983040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:17.983774 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:17.996040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:17.996697 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:18.000747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:18.000747 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:18.197441 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:18.257907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:18.268054 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-bca3dad7-af19-41b6-b306-0a3e73af207f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1278 microversion: 2.1 time: 0.290423 Jun 14 18:07:18.269463 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 558/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:17 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1278 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:18.673948 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:18.675241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:18.683285 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:18.685210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:18.685210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:18.685210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:18.839758 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:18.862388 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4aca4c6c-c0e9-494b-84f5-c20f3112ea6b tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.196341 Jun 14 18:07:18.863069 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 549/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:18 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:18.876923 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-a643e050-ba1c-41ae-bab5-bc579db28d9c req-ff4d7ef5-fd9d-40b5-98fb-583a78893012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f", "tag": "9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:18.897741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-a643e050-ba1c-41ae-bab5-bc579db28d9c req-ff4d7ef5-fd9d-40b5-98fb-583a78893012 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:18.897991 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-a643e050-ba1c-41ae-bab5-bc579db28d9c req-ff4d7ef5-fd9d-40b5-98fb-583a78893012 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:18.912914 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-a643e050-ba1c-41ae-bab5-bc579db28d9c req-ff4d7ef5-fd9d-40b5-98fb-583a78893012 service nova] Creating event network-changed:9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8 for instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f on hv-cinder-82635 Jun 14 18:07:18.919054 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-a643e050-ba1c-41ae-bab5-bc579db28d9c req-ff4d7ef5-fd9d-40b5-98fb-583a78893012 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047081 Jun 14 18:07:18.920522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 559/1108] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:07:19.293787 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:19.294817 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:19.303035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:19.308109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:19.308109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:19.308109 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:19.516571 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:19.526302 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-754ac347-704a-4333-8d0b-d723864d8230 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1278 microversion: 2.1 time: 0.236723 Jun 14 18:07:19.526867 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 550/1109] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:19 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1278 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:19.877303 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=14 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:19.881521 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:19.882236 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:19.891149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:19.891627 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:19.892473 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:19.892910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:20.037993 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:20.046460 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3fb3635c-1bc0-47f1-96ec-73aa3feb1a74 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.170355 Jun 14 18:07:20.046918 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 560/1110] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:19 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:20.544932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:20.545690 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:20.552887 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:20.553345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:20.554130 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:20.554570 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:20.696856 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:20.704848 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f8e7eafa-edba-448f-a8ad-1b82767b0aa5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1278 microversion: 2.1 time: 0.164494 Jun 14 18:07:20.714503 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 551/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:20 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:21.072402 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:21.072402 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:21.073691 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:21.074151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:21.074938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:21.075573 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:21.255600 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:21.264552 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3881cda0-f9fb-427b-982a-2b2c6a640376 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1314 microversion: 2.1 time: 0.202897 Jun 14 18:07:21.265258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 561/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:21 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:21.721853 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:21.722448 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:21.730008 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:21.730460 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:21.731241 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:21.731708 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:21.878063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:21.886663 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-54dfa539-d0b4-4b87-bc0d-47d6b5c711f0 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.168689 Jun 14 18:07:21.887253 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 552/1113] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:21 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:22.284032 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:22.287070 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:22.304979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:22.308035 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:22.308994 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:22.309634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:22.637928 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:22.646171 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5dddb322-1885-4972-88a0-2b11e99ebe7c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1463 microversion: 2.1 time: 0.366969 Jun 14 18:07:22.646749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 562/1114] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:22 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1463 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:22.734032 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:22.734851 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:22.741951 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:22.742407 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:22.743210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:22.744256 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:22.778379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:07:22.908750 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:22.910090 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:22.920634 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:22.921119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:22.921962 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:22.922404 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:23.109132 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-28a0892d-1b38-4415-9664-6cd3fa37440c tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "DELETE /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 204 len: 0 microversion: 2.1 time: 0.379851 Jun 14 18:07:23.110689 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 553/1115] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:07:22 2022] DELETE /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 14 18:07:23.130678 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:23.132178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:23.133476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:23.139909 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=100 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:23.146347 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:23.147049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:23.148234 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:23.148894 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:23.152467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-53b746ef-6554-4012-8b84-9a4c898977d8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.250690 Jun 14 18:07:23.154736 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 563/1116] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:22 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:23.343335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:23.350924 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-77b49e21-74db-44c8-9bc1-a852343f1755 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1469 microversion: 2.1 time: 0.229135 Jun 14 18:07:23.351537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 554/1117] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:23 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1469 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:24.179866 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:24.180469 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:24.189180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:24.189180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:24.189788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:24.189788 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:24.361360 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:24.373515 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:24.378359 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:24.378514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0cf60d0c-322b-419f-b70a-cadcf8e42d50 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.201298 Jun 14 18:07:24.378514 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 564/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:24 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:24.381791 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:24.382250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:24.383050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:24.383531 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:24.532231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:24.539742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ac83c51e-3ce0-48ef-b59d-ec76233e94de tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1469 microversion: 2.1 time: 0.173507 Jun 14 18:07:24.540332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 555/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:24 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:25.393706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:25.394363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:25.401706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:25.402165 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:25.403214 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:25.403684 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:25.543209 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:25.551216 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b676a7f0-4da2-47d6-9599-bb34e716e989 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.161411 Jun 14 18:07:25.551910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 565/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:25 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:25.558215 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:25.558842 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:25.565984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:25.566435 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:25.567231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:25.567701 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:25.733345 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:25.754361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8ef1fd63-db9e-4557-9505-e6a7d9c6d315 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1469 microversion: 2.1 time: 0.188911 Jun 14 18:07:25.754361 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 556/1121] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:25 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:26.570416 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:26.571002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:26.578593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:26.579040 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:26.579842 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:26.580270 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:26.725016 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:26.733146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c13ccb26-e053-420a-b94f-461408727b1d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.166654 Jun 14 18:07:26.733724 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 566/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:26 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:26.762420 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:26.763025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:26.770672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:26.771042 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:26.771866 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:26.772307 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:26.921408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:26.929265 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f2804ceb-2980-4c69-84d0-537b5088c626 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1469 microversion: 2.1 time: 0.171767 Jun 14 18:07:26.929983 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 557/1123] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:26 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:27.409393 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-2a1cc95b-5181-4696-addd-f6062ce27d6b req-b180e772-4d6d-4457-82be-adaa134051f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2bfe57-011a-4218-9b1b-4c7caa6f25c7", "name": "network-vif-deleted", "tag": "b9ad1e25-8399-492a-b7a0-7b3f3b82fe49"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:27.418567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-2a1cc95b-5181-4696-addd-f6062ce27d6b req-b180e772-4d6d-4457-82be-adaa134051f5 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:27.419027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-2a1cc95b-5181-4696-addd-f6062ce27d6b req-b180e772-4d6d-4457-82be-adaa134051f5 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:27.432003 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-2a1cc95b-5181-4696-addd-f6062ce27d6b req-b180e772-4d6d-4457-82be-adaa134051f5 service nova] Creating event network-vif-deleted:b9ad1e25-8399-492a-b7a0-7b3f3b82fe49 for instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 on hv-cinder-82635 Jun 14 18:07:27.437855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-2a1cc95b-5181-4696-addd-f6062ce27d6b req-b180e772-4d6d-4457-82be-adaa134051f5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032065 Jun 14 18:07:27.438475 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 567/1124] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:07:27.750952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:27.752183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:27.761150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:27.761615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:27.762414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:27.763020 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:27.926795 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:27.935624 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-795379bc-c0f1-4a43-a3ce-f3503f377aaf tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.188631 Jun 14 18:07:27.938110 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 558/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:27 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:27.953836 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:27.955188 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:27.960772 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:27.961254 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:27.962309 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:27.962902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:27.995211 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:27.995689 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:27.996177 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lazy-loading 'fault' on Instance uuid 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:07:28.039883 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad2bc23473c147e4b7ae8dcef1ae58ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bab9329cb961497f9923d611541a4d17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:28.048353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4f02e03c-451c-4ca8-98b6-c2d6757282a3 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 200 len: 1304 microversion: 2.1 time: 0.100069 Jun 14 18:07:28.048937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 568/1126] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:27 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:28.956228 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:28.962806 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:28.965404 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:28.965869 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:28.966690 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:28.967135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:29.068001 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:29.068420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] [instance: 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:29.081417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:29.081417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:29.081417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:29.081417 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:29.094464 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] HTTP exception thrown: Instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 could not be found. Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Request method failure captured: Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 HTTP/1.1 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqM5DlPl6ob3Aiw4uKOKV-37svQS3_yr48jrLzdpsA9qP0sR3ipFElZ6GDryVkF_iZHDdxAa3isZysOyKyxhEv8pLnaoSgdru2qMp9RyCdlSY1M1PX_03o2Z2zui62-p7efBMQKJpwTLQIj-O0uW6lHtFZVo6nSL4gHSQvRtC0NxlhN4 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: bab9329cb961497f9923d611541a4d17 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-VolumesNegativeTest-86103134 Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:07:29.096233 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bab9329cb961497f9923d611541a4d17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bab9329cb961497f9923d611541a4d17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bab9329cb961497f9923d611541a4d17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bab9329cb961497f9923d611541a4d17", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-VolumesNegativeTest-86103134 Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: bab9329cb961497f9923d611541a4d17 Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-VolumesNegativeTest-86103134 Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-VolumesNegativeTest-86103134-project Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: ad2bc23473c147e4b7ae8dcef1ae58ca Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-VolumesNegativeTest-86103134-project Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 could not be found. Jun 14 18:07:29.097964 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '1f2bfe57-011a-4218-9b1b-4c7caa6f25c7'} Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 could not be found. Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:07:29.098904 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 could not be found. Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 could not be found. Jun 14 18:07:29.100562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:07:29.101987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] Returning 404 to user: Instance 1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:07:29.101987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-911c4702-f656-472f-add9-75e17460ca07 tempest-VolumesNegativeTest-86103134 tempest-VolumesNegativeTest-86103134-project] 10.222.0.36 "GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7" status: 404 len: 111 microversion: 2.1 time: 0.034487 Jun 14 18:07:29.101987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 569/1127] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:29 2022] GET /compute/v2.1/servers/1f2bfe57-011a-4218-9b1b-4c7caa6f25c7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:07:29.121972 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:29.132747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9ea01f7e-9603-4a1c-8e0e-c509a74bda56 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.181425 Jun 14 18:07:29.133531 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 559/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:28 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:30.151706 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:30.152374 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:30.160597 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:30.161054 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:30.161890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:30.162351 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:30.303201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:30.311582 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-042bfb68-1240-4fff-8fb7-2d92f8882b51 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.163900 Jun 14 18:07:30.312154 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 570/1129] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:30 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:31.331713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:31.332315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:31.339696 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:31.340147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:31.340913 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:31.341343 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:31.509649 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:31.521600 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-13d11543-bcba-4483-baf1-187e23182f63 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.193620 Jun 14 18:07:31.530235 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 560/1130] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:31 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:32.542526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:32.543290 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:32.547049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:32.551708 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:32.551910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:32.553019 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:32.553553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:32.715257 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:32.724020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-5a771c48-cd91-40b6-af3c-26ff3fc807b5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.185702 Jun 14 18:07:32.724625 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 571/1131] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:32 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:07:33.115838 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-0a5aa494-bb05-42a2-8aa3-744503786462 req-65a2e355-ec59-46e6-8d0a-daf202ef2f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f", "name": "network-vif-plugged", "status": "completed", "tag": "9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:33.121315 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:07:33.126508 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-0a5aa494-bb05-42a2-8aa3-744503786462 req-65a2e355-ec59-46e6-8d0a-daf202ef2f1b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:33.126952 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-0a5aa494-bb05-42a2-8aa3-744503786462 req-65a2e355-ec59-46e6-8d0a-daf202ef2f1b service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:33.139052 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-0a5aa494-bb05-42a2-8aa3-744503786462 req-65a2e355-ec59-46e6-8d0a-daf202ef2f1b service nova] Creating event network-vif-plugged:9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8 for instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f on hv-cinder-82635 Jun 14 18:07:33.144150 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-0a5aa494-bb05-42a2-8aa3-744503786462 req-65a2e355-ec59-46e6-8d0a-daf202ef2f1b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Jun 14 18:07:33.144725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 561/1132] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:07:33.742695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:33.743373 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:33.749946 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:33.750466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:33.751241 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:33.751720 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:33.901363 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:33.909930 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-051e4d10-fc4c-44a5-ad58-0c2ca0fad46c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1266 microversion: 2.1 time: 0.171038 Jun 14 18:07:33.910631 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 572/1133] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:33 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:34.929211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:34.929211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:34.937645 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:34.938102 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:34.938880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:34.939320 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:35.082724 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:35.091454 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4221c457-4911-46db-b827-4cc7b9ef92ed tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1453 microversion: 2.1 time: 0.168268 Jun 14 18:07:35.092024 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 562/1134] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:34 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:35.109184 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:07:35.109817 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:07:35.116258 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:35.116710 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:35.117484 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:35.118100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:35.258819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:07:35.266938 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b007c084-cf87-47fb-9d9e-a1e7810138d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1453 microversion: 2.1 time: 0.162548 Jun 14 18:07:35.267583 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 573/1135] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:07:35 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:07:37.726873 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-ccd6092a-9417-49a1-a8b6-22c0028fd5b2 req-f62179d6-10cc-41e8-a9f5-87b0153f5ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f", "tag": "9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:07:37.738641 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-ccd6092a-9417-49a1-a8b6-22c0028fd5b2 req-f62179d6-10cc-41e8-a9f5-87b0153f5ba8 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:07:37.739081 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-ccd6092a-9417-49a1-a8b6-22c0028fd5b2 req-f62179d6-10cc-41e8-a9f5-87b0153f5ba8 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:07:37.753142 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-ccd6092a-9417-49a1-a8b6-22c0028fd5b2 req-f62179d6-10cc-41e8-a9f5-87b0153f5ba8 service nova] Creating event network-changed:9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8 for instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f on hv-cinder-82635 Jun 14 18:07:37.758502 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-ccd6092a-9417-49a1-a8b6-22c0028fd5b2 req-f62179d6-10cc-41e8-a9f5-87b0153f5ba8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035671 Jun 14 18:07:37.759231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 563/1136] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:01.102506 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0b3d9d6b-5a7c-417c-bb07-bf7c66f3743b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Action: 'create', calling method: .version_select at 0x7fbafc820820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1052617700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKffUlq1YNzu2yJdjKmfsCcdNNuDcy7YZB0/foVqtKgK2N+bhnGgxqzs1tabp2is0Zps9RvmD59wuaQcl9rWbOg0HWp2w3/PkulD+gn0yzxn0/JS51b07AyAWKcl6omlvQ=="}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:01.107473 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=5 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:01.108151 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=54 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:01.119110 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-0b3d9d6b-5a7c-417c-bb07-bf7c66f3743b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Getting quotas for project 1ca62d7c1e1c4d61a1b3c94f0068b5c8. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:08:01.123132 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.quota [None req-0b3d9d6b-5a7c-417c-bb07-bf7c66f3743b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Getting quotas for user b2686c4f76544b0c996c15d619b702ba and project 1ca62d7c1e1c4d61a1b3c94f0068b5c8. Resources: {'key_pairs'} {{(pid=125161) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:08:01.235126 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0b3d9d6b-5a7c-417c-bb07-bf7c66f3743b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.136694 Jun 14 18:08:01.235689 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 574/1137] 10.222.0.36 () {60 vars in 1158 bytes} [Tue Jun 14 18:08:01 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:01.334521 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1060552351", "imageRef": "6aacd96f-e45a-4e80-b709-2184d75d3090", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1052617700", "networks": [{"uuid": "56e005bb-1a69-4d18-b8ef-057aeba0a648"}]}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:01.342238 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=5 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:01.349897 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:01.385766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] validate_networks() for [('56e005bb-1a69-4d18-b8ef-057aeba0a648', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:08:01.770945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:08:01.771410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:08:01.771888 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:08:01.772334 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:08:01.772768 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:08:01.783043 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:01.783538 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:01.784341 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:01.784779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:01.802678 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Getting quotas for project 1ca62d7c1e1c4d61a1b3c94f0068b5c8. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:08:01.806616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Getting quotas for user b2686c4f76544b0c996c15d619b702ba and project 1ca62d7c1e1c4d61a1b3c94f0068b5c8. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:08:01.818251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:08:01.821223 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6aacd96f-e45a-4e80-b709-2184d75d3090',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:08:02.008378 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8884fe37-adc0-4f03-92a9-5df275ce7de9 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678317 Jun 14 18:08:02.009106 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 564/1138] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:08:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:08:02.026124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-459382f4-8d6f-427e-8c4b-68e6c992812d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:02.026124 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-459382f4-8d6f-427e-8c4b-68e6c992812d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:02.094003 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-459382f4-8d6f-427e-8c4b-68e6c992812d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:02.101792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-459382f4-8d6f-427e-8c4b-68e6c992812d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1259 microversion: 2.1 time: 0.085835 Jun 14 18:08:02.102563 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 575/1139] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:02 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1259 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:03.122250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4246dfe2-0b3e-46a2-bf0a-afe87a7963b1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:03.122250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4246dfe2-0b3e-46a2-bf0a-afe87a7963b1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:03.175777 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4246dfe2-0b3e-46a2-bf0a-afe87a7963b1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:03.182729 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4246dfe2-0b3e-46a2-bf0a-afe87a7963b1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1259 microversion: 2.1 time: 0.066686 Jun 14 18:08:03.185551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 565/1140] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:03 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:04.200051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:04.200674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:04.207825 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:04.208385 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:04.209227 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:04.209740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:04.316413 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:04.318337 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-9d3a5c01-a814-4641-a54c-85b23a251f2b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1319 microversion: 2.1 time: 0.122913 Jun 14 18:08:04.327937 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 576/1141] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:04 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1319 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:05.339790 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:05.341063 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:05.369273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:05.371233 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:05.372326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:05.372944 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:05.588220 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:05.608147 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1c7e03df-df58-4b6e-8aa3-5dac98aa5b7e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.268397 Jun 14 18:08:05.609796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 566/1142] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:05 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:06.627058 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:06.627850 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:06.634517 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:06.634970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:06.635829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:06.636737 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:06.777442 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:06.786329 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7e66043d-868e-42de-892b-0f93f3295baf tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.163301 Jun 14 18:08:06.786998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 577/1143] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:06 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:07.811250 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:07.811916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:07.818757 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:07.819551 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:07.820350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:07.820794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:07.972346 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:07.980086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-5ce611e0-426d-4211-9d1f-a9ff657142ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.172657 Jun 14 18:08:07.980794 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 567/1144] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:07 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:08.998978 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:08.999660 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:09.006080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:09.006609 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:09.007507 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:09.008012 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:09.166130 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:09.174961 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-d0e24e1c-410d-4831-80a2-ea7ef1949b54 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.180697 Jun 14 18:08:09.175555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 578/1145] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:08 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:10.193830 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:10.194498 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:10.203062 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:10.203544 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:10.204332 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:10.204762 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:10.394134 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:10.403800 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-332f5030-0b08-4b71-86fb-ba06b5831540 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.213830 Jun 14 18:08:10.404386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 568/1146] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:10 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:11.421555 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:11.422161 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:11.429382 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:11.429847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:11.430664 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:11.431209 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:11.770049 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:11.779286 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0312e50f-4420-4be3-9026-93ea02557181 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.362113 Jun 14 18:08:11.788959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 579/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:11 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:12.796822 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:12.797432 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:12.799825 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:12.804955 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:12.805476 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:12.806671 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:12.807116 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:13.023051 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:13.032750 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-63104656-7765-4dfd-bd2d-88b39b6746c4 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.239918 Jun 14 18:08:13.033328 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 569/1148] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:12 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:14.045119 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-f14e0f13-0838-4e6c-bce1-76a943fb9f06 req-1a1b3f4c-ef31-45c7-b6a7-24397bf6b75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:14.050388 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:14.051157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:14.053245 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=8 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:14.060349 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:14.060841 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:14.061628 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:14.062073 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:14.064528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:14.072103 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-f14e0f13-0838-4e6c-bce1-76a943fb9f06 req-1a1b3f4c-ef31-45c7-b6a7-24397bf6b75e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:14.072908 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-f14e0f13-0838-4e6c-bce1-76a943fb9f06 req-1a1b3f4c-ef31-45c7-b6a7-24397bf6b75e service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:14.087988 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-f14e0f13-0838-4e6c-bce1-76a943fb9f06 req-1a1b3f4c-ef31-45c7-b6a7-24397bf6b75e service nova] Creating event network-changed:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:08:14.095024 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-f14e0f13-0838-4e6c-bce1-76a943fb9f06 req-1a1b3f4c-ef31-45c7-b6a7-24397bf6b75e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055726 Jun 14 18:08:14.096000 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 580/1149] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:14.224350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:14.232425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8aa3d680-1df8-452a-a167-f019e83f22c2 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.186483 Jun 14 18:08:14.233016 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 570/1150] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:14 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:08:15.252353 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:15.253055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:15.260104 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:15.260559 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:15.261695 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:15.261826 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:15.400641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:15.409763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-07fe394c-15f3-4d8c-8f0e-42f9ddc8527a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.163941 Jun 14 18:08:15.410379 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 581/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:15 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:08:16.427695 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:16.428316 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:16.435727 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:16.436183 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:16.436967 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:16.437408 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:16.570023 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:16.578056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8f7d4821-b8d1-4504-99fe-887258dc7161 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.154261 Jun 14 18:08:16.578625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 571/1152] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:16 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:17.596359 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:17.597332 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:17.609238 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:17.609714 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:17.610490 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:17.610933 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:17.758856 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:17.766477 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-29980769-4cee-42a2-9a7d-43e88c96cfa6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.175013 Jun 14 18:08:17.767051 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 582/1153] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:17 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:18.790018 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:18.790659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:18.798423 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:18.798864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:18.799819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:18.800267 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:18.948500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:18.957366 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-60f4eba4-139b-479a-9c35-2cbb82542b55 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.171143 Jun 14 18:08:18.957957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 572/1154] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:18 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:19.411466 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-73ca4fc1-a456-499e-b1d4-ffba0efe9f5a req-5b2ca874-7405-4dd9-9619-4fb9ae85dc41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "name": "network-vif-plugged", "status": "completed", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:19.430768 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-73ca4fc1-a456-499e-b1d4-ffba0efe9f5a req-5b2ca874-7405-4dd9-9619-4fb9ae85dc41 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:19.437341 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-73ca4fc1-a456-499e-b1d4-ffba0efe9f5a req-5b2ca874-7405-4dd9-9619-4fb9ae85dc41 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:19.452473 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-73ca4fc1-a456-499e-b1d4-ffba0efe9f5a req-5b2ca874-7405-4dd9-9619-4fb9ae85dc41 service nova] Creating event network-vif-plugged:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:08:19.462061 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-73ca4fc1-a456-499e-b1d4-ffba0efe9f5a req-5b2ca874-7405-4dd9-9619-4fb9ae85dc41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053767 Jun 14 18:08:19.463160 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 583/1155] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:19.975440 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:19.976335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:19.984907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:19.985359 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:19.986191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:19.986674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:20.172059 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:20.180210 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-29417e3a-441b-4e71-9b0e-93621716164e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.209384 Jun 14 18:08:20.181127 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 573/1156] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:19 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:21.203386 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:21.204093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:21.210481 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:21.210987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:21.211805 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:21.212248 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:21.420185 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:21.428262 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f257a524-a422-4b69-8619-2743cd3f546d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1359 microversion: 2.1 time: 0.229750 Jun 14 18:08:21.428919 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 584/1157] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:21 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:22.446471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:22.447205 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:22.454367 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:22.454818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:22.455635 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:22.456067 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:22.593642 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:22.601335 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7c2fe304-16f1-40a7-9b2b-f4a980e2a201 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1547 microversion: 2.1 time: 0.159480 Jun 14 18:08:22.601902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 574/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:22 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:22.619410 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:22.619989 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:22.629221 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:22.629832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:22.630621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:22.631056 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:22.767210 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:22.774798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2bf84b5e-4bf2-44c6-8a93-0bc8cc074a4b tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1547 microversion: 2.1 time: 0.159347 Jun 14 18:08:22.775383 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 585/1159] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:22 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:22.792025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:22.796204 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:22.796980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Searching by: {'deleted': False, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8'} {{(pid=125162) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 14 18:08:22.804011 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:22.804458 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:22.805251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:22.805686 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:22.897708 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.multi_cell_list [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125162) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 14 18:08:23.000864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8c5bcf15-fb63-439d-b5fd-07c0fbe1316f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212965 Jun 14 18:08:23.001406 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 575/1160] 10.222.0.36 () {58 vars in 1124 bytes} [Tue Jun 14 18:08:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:23.011407 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:23.012020 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:23.018260 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:23.018716 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:23.019526 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:23.019970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:23.162544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:23.171778 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e456c302-4f57-4769-a1b6-53ff5faa5a2a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1547 microversion: 2.1 time: 0.163692 Jun 14 18:08:23.172553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 586/1161] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:23 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:08:25.146994 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaa142d9-dc3c-4735-98f8-6eeb7daef59b"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:25.148094 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:25.155540 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:25.156064 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:25.156790 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:25.157231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:26.158958 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f0603038-e7b2-460b-8060-4cefcc2f9780 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.015782 Jun 14 18:08:26.159742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 576/1162] 10.222.0.36 () {60 vars in 1322 bytes} [Tue Jun 14 18:08:25 2022] POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments => generated 194 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:28.494976 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:08:28.495753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:08:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:08:33.741352 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:33.742088 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:33.744809 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:33.745669 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=58 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:33.750467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:33.751222 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:33.751835 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:33.752267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:33.890030 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:33.898415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8e397e07-c2ea-44fd-a30b-02a32a4cb145 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1593 microversion: 2.1 time: 0.160836 Jun 14 18:08:33.899072 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 587/1163] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:33 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:36.178273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-2e607ccb-01a0-40e5-a338-63a866cc80a9 req-9e21e3bb-d486-49c7-b8b7-b1a0c1ff1b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:36.185089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:36.186796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:36.186796 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:36.192550 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-2e607ccb-01a0-40e5-a338-63a866cc80a9 req-9e21e3bb-d486-49c7-b8b7-b1a0c1ff1b7f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:36.192892 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-2e607ccb-01a0-40e5-a338-63a866cc80a9 req-9e21e3bb-d486-49c7-b8b7-b1a0c1ff1b7f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:36.205766 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-2e607ccb-01a0-40e5-a338-63a866cc80a9 req-9e21e3bb-d486-49c7-b8b7-b1a0c1ff1b7f service nova] Creating event network-changed:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:08:36.210742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-2e607ccb-01a0-40e5-a338-63a866cc80a9 req-9e21e3bb-d486-49c7-b8b7-b1a0c1ff1b7f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037505 Jun 14 18:08:36.211559 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 577/1164] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:38.855693 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1885637448"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:38.859361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:38.863596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:38.864055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:38.864821 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:38.865769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:39.011787 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.network.security_group_api [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Adding security group 161dd0db-1ff8-4ec6-9032-928a47460ed2 to port 7465b33a-887a-4a6a-92f1-41cd72998730 Jun 14 18:08:39.502218 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1c6bd14e-b389-415a-963a-ad590b6fe6ab tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/action" status: 202 len: 0 microversion: 2.1 time: 0.650229 Jun 14 18:08:39.504059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 588/1165] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:08:38 2022] POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 14 18:08:39.515397 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:39.523910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:39.528965 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-14f794c3-c812-405e-af37-3c26ee2f29ad req-572a3c15-8ad7-4dd3-9939-af4a122b4336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:39.539243 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:39.544092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:39.548428 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:39.549168 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:39.557017 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-14f794c3-c812-405e-af37-3c26ee2f29ad req-572a3c15-8ad7-4dd3-9939-af4a122b4336 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:39.557529 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-14f794c3-c812-405e-af37-3c26ee2f29ad req-572a3c15-8ad7-4dd3-9939-af4a122b4336 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:39.573035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-14f794c3-c812-405e-af37-3c26ee2f29ad req-572a3c15-8ad7-4dd3-9939-af4a122b4336 service nova] Creating event network-changed:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:08:39.578537 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-14f794c3-c812-405e-af37-3c26ee2f29ad req-572a3c15-8ad7-4dd3-9939-af4a122b4336 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069618 Jun 14 18:08:39.580706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 578/1166] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:08:39.827700 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:39.839544 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2084f2c4-20fa-4033-9627-8590a162e5cd tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1759 microversion: 2.1 time: 0.328408 Jun 14 18:08:39.840273 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 589/1167] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:39 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1759 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:53.810815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:08:53.811899 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:53.820561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:53.821119 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:53.821860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:53.822304 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:54.031380 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e314447d-ca5e-42f4-af99-491ad6818cc0 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/action" status: 202 len: 0 microversion: 2.1 time: 0.224741 Jun 14 18:08:54.032672 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 579/1168] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:08:53 2022] POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:08:54.041097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:54.042910 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:54.043892 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=6 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:54.044560 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=16 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:08:54.049489 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:54.049948 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:54.050722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:54.051163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:54.231048 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:54.239334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-71db6442-292a-46d0-a82a-86f671bfed64 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1751 microversion: 2.1 time: 0.203067 Jun 14 18:08:54.239902 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 590/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:54 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:55.259251 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:55.259966 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:55.266151 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:55.266598 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:55.267518 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:55.267953 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:55.421870 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:55.430556 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-408d9b53-c327-4ad0-a6d6-f31468374ba3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.177109 Jun 14 18:08:55.431125 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 580/1170] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:55 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:56.448522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:56.449163 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:56.455641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:56.456095 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:56.456855 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:56.457290 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:56.607093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:56.615401 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-a52397af-cbf8-4290-8378-baba9601063d tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.171192 Jun 14 18:08:56.615972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 591/1171] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:56 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:57.633191 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:57.633744 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:57.640759 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:57.641211 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:57.641973 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:57.642410 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:57.785305 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:57.793311 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-069882cd-cedb-49d8-bac7-26b0c2c74d34 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.164043 Jun 14 18:08:57.793869 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 581/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:57 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:58.810346 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:58.810959 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:58.817519 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:58.817974 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:58.818741 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:58.819180 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:58.963559 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:08:58.971522 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b4febbd4-33ef-4194-8ccb-e7a4bcfc9ac6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.165169 Jun 14 18:08:58.972086 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 592/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:58 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:08:59.989819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:08:59.990563 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:08:59.998447 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:08:59.998904 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:08:59.999797 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:00.000243 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:00.149548 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:00.158674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-737f466d-5933-4bcd-a1b3-e52642c750b3 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.172645 Jun 14 18:09:00.159139 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 582/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:08:59 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:01.177637 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:01.178246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:01.185434 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:01.185885 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:01.186651 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:01.187089 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:01.337864 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:01.346080 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-28e0d380-7f63-428a-bcfb-3631bf6b4529 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.172624 Jun 14 18:09:01.346630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 593/1175] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:01 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:02.363779 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:02.364383 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:02.371819 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:02.372274 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:02.373046 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:02.373482 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:02.525363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:02.534217 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2a851fa0-10df-48e2-87ac-a826c66069b6 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.174258 Jun 14 18:09:02.534788 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 583/1176] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:02 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:03.552707 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:03.553283 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:03.560362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:03.560824 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:03.561593 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:03.562031 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:03.706970 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:03.715159 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-beb369f8-1c77-4eac-9894-d7c82fccb7c1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.166384 Jun 14 18:09:03.715841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 594/1177] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:03 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:04.732287 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:04.732930 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:04.739632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:04.740086 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:04.740860 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:04.741296 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:04.886971 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:04.895227 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4f7d55a0-22a2-495a-801b-857c5e14add1 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1756 microversion: 2.1 time: 0.166886 Jun 14 18:09:04.895818 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 584/1178] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:04 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:05.913674 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:05.914280 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:05.921389 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:05.921877 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:05.922637 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:05.923066 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:06.070763 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:06.079887 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2946a9e0-a989-4e97-be5f-3505d407d045 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1759 microversion: 2.1 time: 0.170002 Jun 14 18:09:06.081759 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 595/1179] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:05 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:12.762916 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1717643872", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1930342607", "security_groups": [{"name": "tempest-secgroup-smoke-163578328"}], "block_device_mapping_v2": [{"uuid": "22785ac0-a140-4254-8d4b-e322b804abfe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "77be5dba-7c4d-415d-be45-9164b79f49bd"}]}} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:12.881647 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.network.neutron [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] validate_networks() for [('77be5dba-7c4d-415d-be45-9164b79f49bd', None, None, None, None, None)] {{(pid=125162) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 14 18:09:13.312222 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Flavor limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 14 18:09:13.312648 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Image limits 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 14 18:09:13.313118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Flavor pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 14 18:09:13.313525 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Image pref 0:0:0 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 14 18:09:13.313932 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.virt.hardware [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 14 18:09:13.322880 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:13.324207 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:13.324207 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:13.325178 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:13.343219 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for project f61370c4497b496487383283e474bc3a. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 14 18:09:13.347676 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.quota [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Getting quotas for user da59091825d44440887d6ef9c542b1ce and project f61370c4497b496487383283e474bc3a. Resources: {'instances', 'cores', 'ram'} {{(pid=125162) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 14 18:09:13.409348 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Going to run 1 instances... {{(pid=125162) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 14 18:09:13.411499 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22785ac0-a140-4254-8d4b-e322b804abfe',volume_size=None,volume_type=None)] {{(pid=125162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 14 18:09:13.860859 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-e69438f3-5da5-47e0-b2d2-f82b87b09706 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.101873 Jun 14 18:09:13.861989 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 585/1180] 10.222.0.36 () {60 vars in 1146 bytes} [Tue Jun 14 18:09:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 14 18:09:13.882336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-63ad8052-b45f-4ab5-a14f-a583322a8b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:13.882336 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-63ad8052-b45f-4ab5-a14f-a583322a8b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:13.938365 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-63ad8052-b45f-4ab5-a14f-a583322a8b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:13.945361 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-63ad8052-b45f-4ab5-a14f-a583322a8b3d tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1095 microversion: 2.1 time: 0.072880 Jun 14 18:09:13.946149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 596/1181] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:13 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:14.965914 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-7bad0292-0b10-4528-8692-c376528923d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:14.967555 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-7bad0292-0b10-4528-8692-c376528923d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:15.028561 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-7bad0292-0b10-4528-8692-c376528923d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:15.036416 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-7bad0292-0b10-4528-8692-c376528923d9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1095 microversion: 2.1 time: 0.078036 Jun 14 18:09:15.037161 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 586/1182] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:14 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:16.053550 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-83f34dc3-4060-4b5c-86ae-85d362db3a23 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:16.054167 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-83f34dc3-4060-4b5c-86ae-85d362db3a23 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:16.076673 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=36 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:16.117268 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-83f34dc3-4060-4b5c-86ae-85d362db3a23 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:16.126570 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-83f34dc3-4060-4b5c-86ae-85d362db3a23 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1095 microversion: 2.1 time: 0.076827 Jun 14 18:09:16.127452 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 597/1183] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:16 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:17.143999 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-897ed39b-2ddf-45a7-a70c-1ee44e990ef8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:17.144625 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-897ed39b-2ddf-45a7-a70c-1ee44e990ef8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:17.200479 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-897ed39b-2ddf-45a7-a70c-1ee44e990ef8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:17.207500 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-897ed39b-2ddf-45a7-a70c-1ee44e990ef8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1095 microversion: 2.1 time: 0.067383 Jun 14 18:09:17.208082 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 587/1184] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:17 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:09:18.224827 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:18.225428 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:18.232907 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:18.233357 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:18.234136 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:18.234572 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:18.298758 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:18.306629 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-2ab9ed8a-9d73-42f4-83c3-e92a5f36cd1e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1145 microversion: 2.1 time: 0.086654 Jun 14 18:09:18.307392 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 598/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:18 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:19.324975 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:19.326436 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:19.333483 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:19.333940 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:19.334726 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:19.335157 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:19.410985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:19.424007 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-32357afa-bc47-478d-b778-53124b8398ab tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1145 microversion: 2.1 time: 0.099559 Jun 14 18:09:19.424007 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 588/1186] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:19 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:20.440729 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:20.440729 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:20.446818 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:20.447461 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:20.448250 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:20.448688 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:20.532789 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:20.540653 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4e008a8a-8e49-4ac8-86e8-12014389e806 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1201 microversion: 2.1 time: 0.105916 Jun 14 18:09:20.541081 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 599/1187] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:20 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:21.560577 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:21.565471 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:21.583054 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:21.584184 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:21.584430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:21.584748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:21.751276 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:21.761730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-19af629d-2514-4b19-91fb-1e42cb9ccdcb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1278 microversion: 2.1 time: 0.206969 Jun 14 18:09:21.762576 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 589/1188] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:21 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:22.584420 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-0fea2daf-52c4-4d0a-8e59-5dbb4d70ec78 req-eaaca93f-a3a3-4a8c-bf0e-de2be5c30576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e771301-ccae-47aa-afc5-7539cdd17d33", "tag": "14946ed2-de6c-4b3d-9e03-ecc89bedb357"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:22.596002 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0fea2daf-52c4-4d0a-8e59-5dbb4d70ec78 req-eaaca93f-a3a3-4a8c-bf0e-de2be5c30576 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:22.597097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-0fea2daf-52c4-4d0a-8e59-5dbb4d70ec78 req-eaaca93f-a3a3-4a8c-bf0e-de2be5c30576 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:22.616478 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-0fea2daf-52c4-4d0a-8e59-5dbb4d70ec78 req-eaaca93f-a3a3-4a8c-bf0e-de2be5c30576 service nova] Creating event network-changed:14946ed2-de6c-4b3d-9e03-ecc89bedb357 for instance 4e771301-ccae-47aa-afc5-7539cdd17d33 on hv-cinder-82635 Jun 14 18:09:22.623100 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-0fea2daf-52c4-4d0a-8e59-5dbb4d70ec78 req-eaaca93f-a3a3-4a8c-bf0e-de2be5c30576 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045420 Jun 14 18:09:22.623749 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 600/1189] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:09:22.786808 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:22.787451 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:22.794616 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:22.795977 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:22.796706 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:22.797488 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:22.945089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:22.953399 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1d6bfc5e-f037-4ff0-80ef-ab9cf51d1645 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.170975 Jun 14 18:09:22.954650 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 590/1190] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:22 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:23.973434 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:23.974158 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:23.981055 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:23.981500 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:23.983251 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:23.983655 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:24.127591 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:24.135244 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7c997544-db18-4d0a-b5bb-9a62fa4ea95f tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.166072 Jun 14 18:09:24.135829 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 601/1191] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:23 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:25.153173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:25.154841 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:25.156928 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=2 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:25.158025 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:25.162947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:25.163425 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:25.164262 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:25.164689 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:25.167440 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:25.307844 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:25.317089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-d7a06ae9-1c56-4a44-9c71-11a4d82b45a7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.167671 Jun 14 18:09:25.317661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 591/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:25 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:26.334677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:26.335271 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:26.337792 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell0:SELECT=4 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:26.338443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=29 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:26.344354 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:26.344803 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:26.345567 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:26.345999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:26.486405 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:26.494819 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-54487deb-16fa-4ed6-85d4-506ba4ae9a5e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.164033 Jun 14 18:09:26.495443 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 602/1193] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:26 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:27.513441 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:27.514056 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:27.516602 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell0:SELECT=10 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:27.522117 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:27.522567 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:27.523387 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:27.523826 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:27.676657 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:27.684683 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-2af6294f-aad3-48f4-86b7-6d77b158c77e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.175345 Jun 14 18:09:27.686284 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 592/1194] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:27 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:28.706565 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:28.707176 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:28.713777 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:28.714237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:28.715003 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:28.715476 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:28.860510 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:28.868057 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-3632fd8d-0552-44df-b0ff-2f111be8469e tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.165315 Jun 14 18:09:28.868630 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 603/1195] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:28 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:29.886725 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:29.887274 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:29.897389 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:29.897851 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:29.898798 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:29.899226 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:30.059416 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:30.072862 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-8a2636ef-68d3-4ce5-a876-6b48087e3fd6 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.189777 Jun 14 18:09:30.078953 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 593/1196] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:29 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:31.094457 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:31.095068 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:31.101816 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:31.102267 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:31.103045 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:31.103537 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:31.254840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:31.266798 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-c2a3764c-a7d0-4691-8bb5-7d481c738069 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.177111 Jun 14 18:09:31.267793 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 604/1197] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:31 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:09:32.289620 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:32.290260 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:32.298167 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:32.298623 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:32.299452 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:32.299898 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:32.442445 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:32.450714 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-58072be4-0941-4928-b577-d9a018b3c361 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.164408 Jun 14 18:09:32.451664 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 594/1198] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:32 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:33.468225 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:33.469324 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:33.476847 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:33.477303 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:33.480999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:33.480999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:33.617999 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:33.626944 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-de3d08dc-9489-4a10-8628-c580a80cb8eb tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.162849 Jun 14 18:09:33.627554 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 605/1199] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:33 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 14 18:09:33.754048 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-6a55db56-b366-47d1-8896-a4b417cc8ffe req-9d866066-8653-4946-b029-1b9265219ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e771301-ccae-47aa-afc5-7539cdd17d33", "name": "network-vif-plugged", "status": "completed", "tag": "14946ed2-de6c-4b3d-9e03-ecc89bedb357"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:33.762532 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-6a55db56-b366-47d1-8896-a4b417cc8ffe req-9d866066-8653-4946-b029-1b9265219ce3 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:33.763553 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-6a55db56-b366-47d1-8896-a4b417cc8ffe req-9d866066-8653-4946-b029-1b9265219ce3 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:33.776851 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-6a55db56-b366-47d1-8896-a4b417cc8ffe req-9d866066-8653-4946-b029-1b9265219ce3 service nova] Creating event network-vif-plugged:14946ed2-de6c-4b3d-9e03-ecc89bedb357 for instance 4e771301-ccae-47aa-afc5-7539cdd17d33 on hv-cinder-82635 Jun 14 18:09:33.783221 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-6a55db56-b366-47d1-8896-a4b417cc8ffe req-9d866066-8653-4946-b029-1b9265219ce3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096798 Jun 14 18:09:33.783883 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 595/1200] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:09:34.644407 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:34.644955 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:34.651576 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:34.652023 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:34.652958 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:34.654004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:34.790067 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:34.797806 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-7c876841-9cc8-462b-8b43-3b36d4a3d05c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1266 microversion: 2.1 time: 0.157494 Jun 14 18:09:34.798369 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 606/1201] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:34 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:35.816089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:35.816772 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:35.823107 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:35.823591 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:35.824417 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:35.824906 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:35.966753 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:35.974849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-9a66d9d2-04bc-47a3-9d39-1d117c7c4282 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1454 microversion: 2.1 time: 0.163664 Jun 14 18:09:35.980426 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 596/1202] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:35 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:35.992677 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:35.993278 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:36.000987 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:36.001431 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:36.002197 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:36.002643 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:36.146837 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:36.155060 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-e1663dc2-2b3e-4346-a219-c3938d0036ff tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1454 microversion: 2.1 time: 0.166106 Jun 14 18:09:36.155728 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 607/1203] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:35 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:38.329832 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-ef3b8339-478b-47e2-a864-5ba9eef548d7 req-12def992-bed6-46e7-8ec1-bda0f99e6b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e771301-ccae-47aa-afc5-7539cdd17d33", "tag": "14946ed2-de6c-4b3d-9e03-ecc89bedb357"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:38.341099 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-ef3b8339-478b-47e2-a864-5ba9eef548d7 req-12def992-bed6-46e7-8ec1-bda0f99e6b5d service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:38.342049 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-ef3b8339-478b-47e2-a864-5ba9eef548d7 req-12def992-bed6-46e7-8ec1-bda0f99e6b5d service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:38.363886 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-ef3b8339-478b-47e2-a864-5ba9eef548d7 req-12def992-bed6-46e7-8ec1-bda0f99e6b5d service nova] Creating event network-changed:14946ed2-de6c-4b3d-9e03-ecc89bedb357 for instance 4e771301-ccae-47aa-afc5-7539cdd17d33 on hv-cinder-82635 Jun 14 18:09:38.369846 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-ef3b8339-478b-47e2-a864-5ba9eef548d7 req-12def992-bed6-46e7-8ec1-bda0f99e6b5d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111656 Jun 14 18:09:38.370685 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 597/1204] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:09:38.557626 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1885637448"}} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:38.558502 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:38.566898 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:38.567380 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:38.568467 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:38.568920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:38.838302 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.network.security_group_api [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Removing security group 161dd0db-1ff8-4ec6-9032-928a47460ed2 from port 7465b33a-887a-4a6a-92f1-41cd72998730 Jun 14 18:09:39.511867 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-1c6a0e55-d903-491f-ae7b-8e5ba1c6cc69 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/action" status: 202 len: 0 microversion: 2.1 time: 0.958157 Jun 14 18:09:39.512509 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 608/1205] 10.222.0.36 () {60 vars in 1277 bytes} [Tue Jun 14 18:09:38 2022] POST /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/action => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:09:39.654559 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-1a7c0e1d-d093-45c7-ac42-c7f9e9c60f46 req-07fe5e46-9e2a-43d0-a5ac-f665115684ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:39.668273 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-1a7c0e1d-d093-45c7-ac42-c7f9e9c60f46 req-07fe5e46-9e2a-43d0-a5ac-f665115684ea service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:39.669811 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-1a7c0e1d-d093-45c7-ac42-c7f9e9c60f46 req-07fe5e46-9e2a-43d0-a5ac-f665115684ea service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:39.689731 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-1a7c0e1d-d093-45c7-ac42-c7f9e9c60f46 req-07fe5e46-9e2a-43d0-a5ac-f665115684ea service nova] Creating event network-changed:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:09:39.696667 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-1a7c0e1d-d093-45c7-ac42-c7f9e9c60f46 req-07fe5e46-9e2a-43d0-a5ac-f665115684ea service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170955 Jun 14 18:09:39.697980 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 598/1206] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:09:41.285362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:41.286004 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:41.287284 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-a7b290e5-a2b6-48d1-8b1e-f2ec0cdcc845 req-262f1384-8193-49d0-88cf-a4cf2abbaa41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:41.295326 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:41.296457 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:41.297342 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:41.297840 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:41.298312 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a7b290e5-a2b6-48d1-8b1e-f2ec0cdcc845 req-262f1384-8193-49d0-88cf-a4cf2abbaa41 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:41.298767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-a7b290e5-a2b6-48d1-8b1e-f2ec0cdcc845 req-262f1384-8193-49d0-88cf-a4cf2abbaa41 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:41.311907 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-a7b290e5-a2b6-48d1-8b1e-f2ec0cdcc845 req-262f1384-8193-49d0-88cf-a4cf2abbaa41 service nova] Creating event network-changed:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:09:41.317505 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-a7b290e5-a2b6-48d1-8b1e-f2ec0cdcc845 req-262f1384-8193-49d0-88cf-a4cf2abbaa41 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034240 Jun 14 18:09:41.318137 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 599/1207] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:09:41.412059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.objects.instance [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lazy-loading 'services' on Instance uuid 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 {{(pid=125161) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 14 18:09:41.675799 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-0717d8c1-a651-49fc-bfdc-8cee8da0186a tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments/eaa142d9-dc3c-4735-98f8-6eeb7daef59b" status: 202 len: 0 microversion: 2.1 time: 0.397898 Jun 14 18:09:41.676802 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 609/1208] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:09:41 2022] DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments/eaa142d9-dc3c-4735-98f8-6eeb7daef59b => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:09:41.695076 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:41.696411 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:41.703986 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:41.704718 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:41.705637 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:41.706181 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:41.738917 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-54344794-9fec-40e8-9451-909f00bf4b51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049897 Jun 14 18:09:41.740129 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 600/1209] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:09:41 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:09:42.752832 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:42.753972 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:42.760400 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:42.760838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:42.761597 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:42.762029 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:42.793237 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-f8f9c439-2fba-44bd-99a2-fee9d3d12bc7 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045931 Jun 14 18:09:42.794608 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 610/1210] 10.222.0.36 () {58 vars in 1301 bytes} [Tue Jun 14 18:09:42 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 14 18:09:42.804864 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:42.805588 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:42.812213 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:42.812730 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:42.813540 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:42.813984 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:42.890465 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] HTTP exception thrown: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 is not attached to volume eaa142d9-dc3c-4735-98f8-6eeb7daef59b Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Request method failure captured: Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments/eaa142d9-dc3c-4735-98f8-6eeb7daef59b HTTP/1.1 Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqM5vbmBV0Fqj2OGdriTVoFbOlID9JSjvyVGhfPe56ueImYV7XliPLxAjLu4o57dAEjcAo2NqZZWun0_637w-xKPxpxqyh_tZlB8Zkl1od3TcH8-zm3Le_sgqChcDW5WVko-YNe6proWyCYWa7LOsgwdDELvk1DuXVPPwrkXhsFt9Y0o Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 1ca62d7c1e1c4d61a1b3c94f0068b5c8 Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-TestMinimumBasicScenario-511785698 Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:09:42.892893 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1ca62d7c1e1c4d61a1b3c94f0068b5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1ca62d7c1e1c4d61a1b3c94f0068b5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1ca62d7c1e1c4d61a1b3c94f0068b5c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1ca62d7c1e1c4d61a1b3c94f0068b5c8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-TestMinimumBasicScenario-511785698 Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 1ca62d7c1e1c4d61a1b3c94f0068b5c8 Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-TestMinimumBasicScenario-511785698 Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-TestMinimumBasicScenario-511785698-project Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: b2686c4f76544b0c996c15d619b702ba Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-TestMinimumBasicScenario-511785698-project Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:09:42.894661 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 is not attached to volume eaa142d9-dc3c-4735-98f8-6eeb7daef59b Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'server_id': '89abf6fa-4b51-4a93-a8ad-5e25c9555be6', 'id': 'eaa142d9-dc3c-4735-98f8-6eeb7daef59b'} Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id eaa142d9-dc3c-4735-98f8-6eeb7daef59b. Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:09:42.895711 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 is not attached to volume eaa142d9-dc3c-4735-98f8-6eeb7daef59b Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 is not attached to volume eaa142d9-dc3c-4735-98f8-6eeb7daef59b Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:42.897038 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Returning 404 to user: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 is not attached to volume eaa142d9-dc3c-4735-98f8-6eeb7daef59b {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:09:42.898231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ffc48150-bf5e-426e-b2bb-85d4b1fdce98 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments/eaa142d9-dc3c-4735-98f8-6eeb7daef59b" status: 404 len: 154 microversion: 2.1 time: 0.093602 Jun 14 18:09:42.898231 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 601/1211] 10.222.0.36 () {58 vars in 1415 bytes} [Tue Jun 14 18:09:42 2022] DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6/os-volume_attachments/eaa142d9-dc3c-4735-98f8-6eeb7daef59b => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:09:44.169734 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:44.170344 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:44.176861 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:44.177316 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:44.178112 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:44.178532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:44.204479 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Going to try to terminate instance {{(pid=125161) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:09:44.500986 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-690cbd95-8d9a-45a5-9785-8cf3c22cf41e tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 204 len: 0 microversion: 2.1 time: 0.335468 Jun 14 18:09:44.501667 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 611/1212] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:09:44 2022] DELETE /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:09:44.510919 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:44.511742 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:44.519135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:44.519748 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:44.520528 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:44.521060 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:44.662985 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:44.671212 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-0f452b85-08d7-4097-9178-0e028627917f tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1553 microversion: 2.1 time: 0.165060 Jun 14 18:09:44.671811 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 602/1213] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:44 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:45.689833 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:45.690532 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:45.697278 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:45.697890 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:45.698529 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:45.698967 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:45.838009 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:45.845854 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-19832d75-fb16-4494-a857-e62af7bef657 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1553 microversion: 2.1 time: 0.160833 Jun 14 18:09:45.846432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 612/1214] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:45 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:46.829175 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [req-7a823b57-2c5e-40f0-9864-c7c216e83c63 req-fe4b4e1b-0fb0-49f6-8d90-f32d2b45ef03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89abf6fa-4b51-4a93-a8ad-5e25c9555be6", "name": "network-vif-deleted", "tag": "7465b33a-887a-4a6a-92f1-41cd72998730"}]} {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:09:46.838050 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7a823b57-2c5e-40f0-9864-c7c216e83c63 req-fe4b4e1b-0fb0-49f6-8d90-f32d2b45ef03 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:46.838495 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [req-7a823b57-2c5e-40f0-9864-c7c216e83c63 req-fe4b4e1b-0fb0-49f6-8d90-f32d2b45ef03 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:46.850674 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.compute.server_external_events [req-7a823b57-2c5e-40f0-9864-c7c216e83c63 req-fe4b4e1b-0fb0-49f6-8d90-f32d2b45ef03 service nova] Creating event network-vif-deleted:7465b33a-887a-4a6a-92f1-41cd72998730 for instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 on hv-cinder-82635 Jun 14 18:09:46.855659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [req-7a823b57-2c5e-40f0-9864-c7c216e83c63 req-fe4b4e1b-0fb0-49f6-8d90-f32d2b45ef03 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Jun 14 18:09:46.856449 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 603/1215] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:09:46.863059 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:46.867701 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:46.870535 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:46.870979 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:46.871769 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:46.872536 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:46.878687 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:09:46.942415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2686c4f76544b0c996c15d619b702ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ca62d7c1e1c4d61a1b3c94f0068b5c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:09:46.950093 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-cc722a95-bac9-4e61-a0ed-e1949d9973ca tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 200 len: 1511 microversion: 2.1 time: 0.090912 Jun 14 18:09:46.951454 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 613/1216] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:46 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 1511 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:09:47.968959 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:47.969652 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] [instance: 89abf6fa-4b51-4a93-a8ad-5e25c9555be6] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:09:47.976467 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:47.976960 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:47.977756 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:09:47.978232 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:09:47.992414 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] HTTP exception thrown: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 could not be found. Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Request method failure captured: Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 HTTP/1.1 Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqM5vbmBV0Fqj2OGdriTVoFbOlID9JSjvyVGhfPe56ueImYV7XliPLxAjLu4o57dAEjcAo2NqZZWun0_637w-xKPxpxqyh_tZlB8Zkl1od3TcH8-zm3Le_sgqChcDW5WVko-YNe6proWyCYWa7LOsgwdDELvk1DuXVPPwrkXhsFt9Y0o Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: 1ca62d7c1e1c4d61a1b3c94f0068b5c8 Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-TestMinimumBasicScenario-511785698 Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:09:47.994089 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1ca62d7c1e1c4d61a1b3c94f0068b5c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/1ca62d7c1e1c4d61a1b3c94f0068b5c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/1ca62d7c1e1c4d61a1b3c94f0068b5c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_1ca62d7c1e1c4d61a1b3c94f0068b5c8", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-TestMinimumBasicScenario-511785698 Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: 1ca62d7c1e1c4d61a1b3c94f0068b5c8 Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-TestMinimumBasicScenario-511785698 Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-TestMinimumBasicScenario-511785698-project Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: b2686c4f76544b0c996c15d619b702ba Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-TestMinimumBasicScenario-511785698-project Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 could not be found. Jun 14 18:09:47.995881 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '89abf6fa-4b51-4a93-a8ad-5e25c9555be6'} Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 could not be found. Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:09:47.996751 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 could not be found. Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 could not be found. Jun 14 18:09:47.998615 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:09:48.006777 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Returning 404 to user: Instance 89abf6fa-4b51-4a93-a8ad-5e25c9555be6 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:09:48.006777 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-4c21b356-ed72-444b-bcc0-c5cba2c4a2ad tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6" status: 404 len: 111 microversion: 2.1 time: 0.031548 Jun 14 18:09:48.006777 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 604/1217] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:09:47 2022] GET /compute/v2.1/servers/89abf6fa-4b51-4a93-a8ad-5e25c9555be6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:09:48.007097 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-53f83832-50f9-4aaa-b5b3-0c2f0f41ca51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] Calling method '.version_select at 0x7fbafc8f8e50>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:09:48.108745 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-53f83832-50f9-4aaa-b5b3-0c2f0f41ca51 tempest-TestMinimumBasicScenario-511785698 tempest-TestMinimumBasicScenario-511785698-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1052617700" status: 202 len: 0 microversion: 2.1 time: 0.107647 Jun 14 18:09:48.109334 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 614/1218] 10.222.0.36 () {58 vars in 1271 bytes} [Tue Jun 14 18:09:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1052617700 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:09:52.889146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:09:52.889146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Tue Jun 14 18:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:11:18.212310 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_api:SELECT=27 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:18.213028 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG dbcounter [-] [125161] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:18.217164 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG dbcounter [-] [125162] Writing DB stats nova_cell1:SELECT=59 {{(pid=125162) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 18:11:18.220265 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-fdc5a072-eb73-470e-b138-2c321f00118b req-b5e47974-ddd7-4fd6-82cf-49e662cbd823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e771301-ccae-47aa-afc5-7539cdd17d33", "tag": "14946ed2-de6c-4b3d-9e03-ecc89bedb357"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:11:18.221876 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:18.222383 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:18.228793 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:18.229249 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:18.230265 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:18.230713 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:18.231025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-fdc5a072-eb73-470e-b138-2c321f00118b req-b5e47974-ddd7-4fd6-82cf-49e662cbd823 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:18.231498 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-fdc5a072-eb73-470e-b138-2c321f00118b req-b5e47974-ddd7-4fd6-82cf-49e662cbd823 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:18.242845 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-fdc5a072-eb73-470e-b138-2c321f00118b req-b5e47974-ddd7-4fd6-82cf-49e662cbd823 service nova] Creating event network-changed:14946ed2-de6c-4b3d-9e03-ecc89bedb357 for instance 4e771301-ccae-47aa-afc5-7539cdd17d33 on hv-cinder-82635 Jun 14 18:11:18.248183 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-fdc5a072-eb73-470e-b138-2c321f00118b req-b5e47974-ddd7-4fd6-82cf-49e662cbd823 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039641 Jun 14 18:11:18.249000 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 615/1219] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:11:18.262115 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:11:18.573386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-93f5af2d-3cc8-40b2-bc36-66a4f71aee33 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "DELETE /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 204 len: 0 microversion: 2.1 time: 0.361431 Jun 14 18:11:18.573386 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 605/1220] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:11:18 2022] DELETE /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:11:18.580272 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:18.581025 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:18.588027 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:18.588512 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:18.589282 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:18.589722 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:18.739444 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:11:18.747246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-946d0058-6d32-443f-99e7-930ea9ebaa18 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1579 microversion: 2.1 time: 0.172316 Jun 14 18:11:18.747838 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 616/1221] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:18 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:11:19.767381 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:19.768118 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:19.791659 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:19.792270 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:19.793077 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:19.793912 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:19.975573 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:11:19.986039 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-1c5f6c33-7c43-4d0f-a6cc-c6506cf351d5 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1579 microversion: 2.1 time: 0.223661 Jun 14 18:11:19.986632 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 606/1222] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:19 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1579 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:11:20.697426 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-c1ed9040-1144-4c32-88d3-ce10ae8c4090 req-e450451a-13aa-45b8-a2f3-a2b26d3b9d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e771301-ccae-47aa-afc5-7539cdd17d33", "name": "network-vif-deleted", "tag": "14946ed2-de6c-4b3d-9e03-ecc89bedb357"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:11:20.706978 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-c1ed9040-1144-4c32-88d3-ce10ae8c4090 req-e450451a-13aa-45b8-a2f3-a2b26d3b9d8a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:20.707493 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-c1ed9040-1144-4c32-88d3-ce10ae8c4090 req-e450451a-13aa-45b8-a2f3-a2b26d3b9d8a service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:20.720558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-c1ed9040-1144-4c32-88d3-ce10ae8c4090 req-e450451a-13aa-45b8-a2f3-a2b26d3b9d8a service nova] Creating event network-vif-deleted:14946ed2-de6c-4b3d-9e03-ecc89bedb357 for instance 4e771301-ccae-47aa-afc5-7539cdd17d33 on hv-cinder-82635 Jun 14 18:11:20.726201 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-c1ed9040-1144-4c32-88d3-ce10ae8c4090 req-e450451a-13aa-45b8-a2f3-a2b26d3b9d8a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032432 Jun 14 18:11:20.727010 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 617/1223] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:11:21.004348 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:21.004945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:21.011849 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:21.012297 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:21.013068 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:21.013712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:21.091519 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:11:21.099923 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-97a7b4c5-b63e-445a-98a6-5b0d1db1efb9 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 200 len: 1226 microversion: 2.1 time: 0.099229 Jun 14 18:11:21.104655 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 607/1224] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:20 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:11:22.118619 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:22.119390 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 4e771301-ccae-47aa-afc5-7539cdd17d33] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:22.126432 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:22.126881 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:22.127680 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:22.128115 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:22.144224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] HTTP exception thrown: Instance 4e771301-ccae-47aa-afc5-7539cdd17d33 could not be found. Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Request method failure captured: Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 HTTP/1.1 Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqM2NF0kgqSvv1eajE_xO5bfj28yI9nhjLpWtv0V7E58RgMnaPTN_g3R0Wop2T2x2bHys0ybedm2lsSmqUvkZZQbYpeoz8zLebxOn-tBwT0WeywNcv8BBLL7oRkSc6y76TfDXX4QrpODjK90HWrs1IvUBVdz34_KpXNeWKwdnuJzDu3g Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:11:22.145941 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61370c4497b496487383283e474bc3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61370c4497b496487383283e474bc3a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: da59091825d44440887d6ef9c542b1ce Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 4e771301-ccae-47aa-afc5-7539cdd17d33 could not be found. Jun 14 18:11:22.147676 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '4e771301-ccae-47aa-afc5-7539cdd17d33'} Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e771301-ccae-47aa-afc5-7539cdd17d33 could not be found. Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:11:22.148621 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e771301-ccae-47aa-afc5-7539cdd17d33 could not be found. Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e771301-ccae-47aa-afc5-7539cdd17d33 could not be found. Jun 14 18:11:22.150301 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:22.152146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Returning 404 to user: Instance 4e771301-ccae-47aa-afc5-7539cdd17d33 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:11:22.152146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-8c147282-355b-482a-bd9f-e44ea0f5d5c7 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33" status: 404 len: 111 microversion: 2.1 time: 0.033509 Jun 14 18:11:22.152146 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 618/1225] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:22 2022] GET /compute/v2.1/servers/4e771301-ccae-47aa-afc5-7539cdd17d33 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:11:26.009747 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:26.010317 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:26.010585 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-fb1ceec5-c7e9-49e5-b204-15a9251087d9 req-578ee202-ad9b-4e3b-9eba-e5596ad1dd1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f", "tag": "9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:11:26.018950 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:26.019430 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:26.020418 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:26.021079 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:26.029362 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-fb1ceec5-c7e9-49e5-b204-15a9251087d9 req-578ee202-ad9b-4e3b-9eba-e5596ad1dd1f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:26.030141 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-fb1ceec5-c7e9-49e5-b204-15a9251087d9 req-578ee202-ad9b-4e3b-9eba-e5596ad1dd1f service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:26.045246 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-fb1ceec5-c7e9-49e5-b204-15a9251087d9 req-578ee202-ad9b-4e3b-9eba-e5596ad1dd1f service nova] Creating event network-changed:9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8 for instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f on hv-cinder-82635 Jun 14 18:11:26.051029 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Going to try to terminate instance {{(pid=125162) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 14 18:11:26.052255 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-fb1ceec5-c7e9-49e5-b204-15a9251087d9 req-578ee202-ad9b-4e3b-9eba-e5596ad1dd1f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045967 Jun 14 18:11:26.057009 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 619/1226] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 14 18:11:26.403872 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-bbb1c642-b57d-4f02-9d62-b5a421932295 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "DELETE /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 204 len: 0 microversion: 2.1 time: 0.397934 Jun 14 18:11:26.404861 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 608/1227] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:11:26 2022] DELETE /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 14 18:11:26.415032 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:26.421415 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:26.422553 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:26.423213 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:26.424056 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:26.424862 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:26.579482 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.policy [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125161) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:11:26.587969 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-b30222fa-49a3-4da3-837c-a5a737add59c tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1577 microversion: 2.1 time: 0.177334 Jun 14 18:11:26.588558 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 620/1228] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:26 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:11:27.606035 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:27.606767 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:27.614557 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:27.615087 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:27.615902 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:27.616367 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:27.755827 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:11:27.763945 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-88c9db5b-85e7-42f3-99e1-2085ce074fe3 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1459 microversion: 2.1 time: 0.162115 Jun 14 18:11:27.764526 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 609/1229] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:27 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1459 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:11:28.455891 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [req-ceeab3d8-cdf2-4aca-a713-4eb83c92cd98 req-af0e2429-cd92-4019-8435-07767971c9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f", "name": "network-vif-deleted", "tag": "9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8"}]} {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 14 18:11:28.464740 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-ceeab3d8-cdf2-4aca-a713-4eb83c92cd98 req-af0e2429-cd92-4019-8435-07767971c9a7 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:28.466495 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [req-ceeab3d8-cdf2-4aca-a713-4eb83c92cd98 req-af0e2429-cd92-4019-8435-07767971c9a7 service nova] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:28.477543 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.compute.server_external_events [req-ceeab3d8-cdf2-4aca-a713-4eb83c92cd98 req-af0e2429-cd92-4019-8435-07767971c9a7 service nova] Creating event network-vif-deleted:9ce6accb-3c82-4515-8d2b-3ecdb3cbacb8 for instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f on hv-cinder-82635 Jun 14 18:11:28.482868 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [req-ceeab3d8-cdf2-4aca-a713-4eb83c92cd98 req-af0e2429-cd92-4019-8435-07767971c9a7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031104 Jun 14 18:11:28.483541 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 621/1230] 10.222.0.36 () {64 vars in 1317 bytes} [Tue Jun 14 18:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 14 18:11:28.781727 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:28.782350 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:28.789929 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:28.790379 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:28.791173 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:28.791640 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:28.864963 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.policy [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da59091825d44440887d6ef9c542b1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61370c4497b496487383283e474bc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125162) authorize /opt/stack/nova/nova/policy.py:199}} Jun 14 18:11:28.877135 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-211d8b29-995f-4589-a0fd-8d6f015e8420 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 200 len: 1226 microversion: 2.1 time: 0.098756 Jun 14 18:11:28.877947 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 610/1231] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:28 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 1226 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 14 18:11:29.897486 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:29.898092 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:29.906295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:29.906295 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:29.906922 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:29.907396 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:29.923497 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] HTTP exception thrown: Instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f could not be found. Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Request method failure captured: Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f HTTP/1.1 Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqM2NF0kgqSvv1eajE_xO5bfj28yI9nhjLpWtv0V7E58RgMnaPTN_g3R0Wop2T2x2bHys0ybedm2lsSmqUvkZZQbYpeoz8zLebxOn-tBwT0WeywNcv8BBLL7oRkSc6y76TfDXX4QrpODjK90HWrs1IvUBVdz34_KpXNeWKwdnuJzDu3g Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:11:29.925224 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61370c4497b496487383283e474bc3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61370c4497b496487383283e474bc3a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: da59091825d44440887d6ef9c542b1ce Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f could not be found. Jun 14 18:11:29.927149 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f'} Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f could not be found. Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:11:29.928207 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f could not be found. Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f could not be found. Jun 14 18:11:29.929920 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:29.931613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Returning 404 to user: Instance 371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:11:29.931613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-4443a684-f0da-4fd5-970a-b612e278fe99 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f" status: 404 len: 111 microversion: 2.1 time: 0.035507 Jun 14 18:11:29.931613 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 622/1232] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:29 2022] GET /compute/v2.1/servers/371bfe9c-3b06-44d3-a50d-dcbf04d6ea6f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:11:30.496453 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:30.497363 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.compute.api [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125162) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:30.505503 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:30.512815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:30.512815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:30.512815 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG oslo_concurrency.lockutils [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:30.523641 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.wsgi [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] HTTP exception thrown: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Request method failure captured: Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: request: DELETE /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 HTTP/1.1 Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept: application/json Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Accept-Encoding: identity Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Connection: close Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Length: 0 Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Content-Type: application/json Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Host: 10.222.0.36 Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Openstack-System-Scope: None Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: User-Agent: python-urllib3/1.26.9 Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Auth-Token: gAAAAABiqM2NF0kgqSvv1eajE_xO5bfj28yI9nhjLpWtv0V7E58RgMnaPTN_g3R0Wop2T2x2bHys0ybedm2lsSmqUvkZZQbYpeoz8zLebxOn-tBwT0WeywNcv8BBLL7oRkSc6y76TfDXX4QrpODjK90HWrs1IvUBVdz34_KpXNeWKwdnuJzDu3g Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Id: None Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Domain-Name: None Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Identity-Status: Confirmed Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Is-Admin-Project: True Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Id: default Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Domain-Name: Default Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Project-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Role: reader,member Jun 14 18:11:30.525326 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Roles: reader,member Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61370c4497b496487383283e474bc3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61370c4497b496487383283e474bc3a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Id: default Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Domain-Name: Default Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Id: da59091825d44440887d6ef9c542b1ce Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: X-User-Name: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: method: > Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: exception: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.527084 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: action_args: {'id': '57c23aa6-b120-47d4-8df1-a727c3e60c85'} Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:11:30.527988 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.529629 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.531644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Returning 404 to user: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. {{(pid=125162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:11:30.531644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-f53399b9-aada-4946-a9a5-13ca3b350b45 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "DELETE /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 404 len: 111 microversion: 2.1 time: 0.034336 Jun 14 18:11:30.531644 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 611/1233] 10.222.0.36 () {58 vars in 1238 bytes} [Tue Jun 14 18:11:30 2022] DELETE /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 14 18:11:30.536562 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '>' {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:30.537176 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.compute.api [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [instance: 57c23aa6-b120-47d4-8df1-a727c3e60c85] Fetching instance by UUID {{(pid=125161) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 14 18:11:30.543379 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:30.543841 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:30.544641 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 14 18:11:30.545082 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG oslo_concurrency.lockutils [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Lock "5d139790-d717-4871-b5fc-a36675c1ea79" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 14 18:11:30.560039 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.wsgi [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] HTTP exception thrown: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Request method failure captured: Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: request: GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 HTTP/1.1 Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept: application/json Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Accept-Encoding: identity Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Connection: close Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Length: 0 Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Content-Type: application/json Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Host: 10.222.0.36 Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Openstack-System-Scope: None Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: User-Agent: python-urllib3/1.26.9 Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Auth-Token: gAAAAABiqM2NF0kgqSvv1eajE_xO5bfj28yI9nhjLpWtv0V7E58RgMnaPTN_g3R0Wop2T2x2bHys0ybedm2lsSmqUvkZZQbYpeoz8zLebxOn-tBwT0WeywNcv8BBLL7oRkSc6y76TfDXX4QrpODjK90HWrs1IvUBVdz34_KpXNeWKwdnuJzDu3g Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Id: None Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Domain-Name: None Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Identity-Status: Confirmed Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Is-Admin-Project: True Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Id: default Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Domain-Name: Default Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Project-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Role: reader,member Jun 14 18:11:30.561586 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Roles: reader,member Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f61370c4497b496487383283e474bc3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f61370c4497b496487383283e474bc3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f61370c4497b496487383283e474bc3a", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}] Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Id: f61370c4497b496487383283e474bc3a Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-Tenant-Name: tempest-TestVolumeBootPattern-1090612432 Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Id: default Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Domain-Name: Default Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Id: da59091825d44440887d6ef9c542b1ce Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: X-User-Name: tempest-TestVolumeBootPattern-1090612432-project Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: method: > Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: exception: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.564744 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: action_args: {'id': '57c23aa6-b120-47d4-8df1-a727c3e60c85'} Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: {{(pid=125161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 14 18:11:30.566403 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. Jun 14 18:11:30.571863 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: ERROR nova.api.openstack.wsgi Jun 14 18:11:30.573811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: DEBUG nova.api.openstack.wsgi [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Returning 404 to user: Instance 57c23aa6-b120-47d4-8df1-a727c3e60c85 could not be found. {{(pid=125161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 14 18:11:30.573811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO nova.api.openstack.requestlog [None req-69bf2151-b1d6-4e7c-a526-d7e6cecde1ad tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85" status: 404 len: 111 microversion: 2.1 time: 0.030476 Jun 14 18:11:30.573811 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: [pid: 125161|app: 0|req: 623/1234] 10.222.0.36 () {58 vars in 1235 bytes} [Tue Jun 14 18:11:30 2022] GET /compute/v2.1/servers/57c23aa6-b120-47d4-8df1-a727c3e60c85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 14 18:11:32.159280 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: DEBUG nova.api.openstack.wsgi [None req-ba4c1714-f1df-451f-ae09-ec69a95f03b8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] Calling method '.version_select at 0x7fbb011cf820>' {{(pid=125162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 14 18:11:32.162957 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba4c1714-f1df-451f-ae09-ec69a95f03b8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [00555a56-e9fe-4d97-8e88-06948d2df8b7] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 14 18:11:33.170698 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba4c1714-f1df-451f-ae09-ec69a95f03b8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] [00555a56-e9fe-4d97-8e88-06948d2df8b7] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 54998. Jun 14 18:11:33.283700 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO nova.api.openstack.requestlog [None req-ba4c1714-f1df-451f-ae09-ec69a95f03b8 tempest-TestVolumeBootPattern-1090612432 tempest-TestVolumeBootPattern-1090612432-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1930342607" status: 202 len: 0 microversion: 2.1 time: 1.129666 Jun 14 18:11:33.284334 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: [pid: 125162|app: 0|req: 612/1235] 10.222.0.36 () {58 vars in 1262 bytes} [Tue Jun 14 18:11:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1930342607 => generated 0 bytes in 1131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 14 18:11:57.689712 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:11:57.690426 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:13:12.898839 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:13:12.899927 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Tue Jun 14 18:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:13:29.806216 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:13:29.806882 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:13:45.904998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:13:45.904998 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Tue Jun 14 18:13:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:15:05.471596 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:15:05.472352 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Tue Jun 14 18:15:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:15:17.699694 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:15:17.700318 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:16:32.908375 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:16:32.908934 dv-cinder-826350-5-iscsi devstack@n-api.service[125161]: Tue Jun 14 18:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:16:48.510554 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:16:48.511144 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 14 18:16:49.815827 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 14 18:16:49.816557 dv-cinder-826350-5-iscsi devstack@n-api.service[125162]: Tue Jun 14 18:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!